2026-09-16T18:27:47.033503Z info FLAG: --concurrency="0" 2026-09-16T18:27:47.033521Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-16T18:27:47.033526Z info FLAG: --help="false" 2026-09-16T18:27:47.033529Z info FLAG: --log_as_json="false" 2026-09-16T18:27:47.033532Z info FLAG: --log_caller="" 2026-09-16T18:27:47.033535Z info FLAG: --log_output_level="default:info" 2026-09-16T18:27:47.033538Z info FLAG: --log_stacktrace_level="default:none" 2026-09-16T18:27:47.033545Z info FLAG: --log_target="[stdout]" 2026-09-16T18:27:47.033549Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-16T18:27:47.033553Z info FLAG: --outlierLogPath="" 2026-09-16T18:27:47.033556Z info FLAG: --profiling="true" 2026-09-16T18:27:47.033559Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-16T18:27:47.033562Z info FLAG: --proxyLogLevel="warning" 2026-09-16T18:27:47.033565Z info FLAG: --serviceCluster="istio-proxy" 2026-09-16T18:27:47.033568Z info FLAG: --stsPort="0" 2026-09-16T18:27:47.033571Z info FLAG: --templateFile="" 2026-09-16T18:27:47.033574Z info FLAG: --tokenManagerPlugin="" 2026-09-16T18:27:47.033583Z info FLAG: --vklog="0" 2026-09-16T18:27:47.033586Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-16T18:27:47.033747Z info Proxy role ips=[10.134.0.37] type=router id=maas-default-gateway-openshift-default-78bb78ff78-l8h2n.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-16T18:27:47.033804Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-16T18:27:47.034804Z info cpu limit detected as 2, setting concurrency 2026-09-16T18:27:47.035017Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-16T18:27:47.035029Z info JWT policy is third-party-jwt 2026-09-16T18:27:47.035034Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-16T18:27:47.036285Z info Starting default Istio SDS Server 2026-09-16T18:27:47.036312Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-16T18:27:47.036336Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-16T18:27:47.036792Z info Opening status port 15020 2026-09-16T18:27:47.037439Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-16T18:27:47.038572Z info sds Starting SDS grpc server 2026-09-16T18:27:47.038591Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-16T18:27:47.038792Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-16T18:27:47.039693Z info Starting proxy agent 2026-09-16T18:27:47.039721Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-16T18:27:47.094958Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=8 2026-09-16T18:27:47.095253Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=8 2026-09-16T18:27:47.100447Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-16T18:27:47.185649Z info ads ADS: new connection for node:1 2026-09-16T18:27:47.186064Z info ads ADS: new connection for node:2 2026-09-16T18:27:47.654705Z info cache generated new workload certificate resourceName=default latency=615.975459ms ttl=23h59m59.345298252s 2026-09-16T18:27:47.654745Z info cache Root cert has changed, start rotating root cert 2026-09-16T18:27:47.654769Z info cache returned workload certificate from cache ttl=23h59m59.345233937s 2026-09-16T18:27:47.654794Z info cache returned workload trust anchor from cache ttl=23h59m59.345206931s 2026-09-16T18:27:47.654885Z info cache returned workload trust anchor from cache ttl=23h59m59.345116302s 2026-09-16T18:27:47.655181Z info cache returned workload trust anchor from cache ttl=23h59m59.344819815s 2026-09-16T18:27:47.696727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:27:53.961196Z info Readiness succeeded in 6.929967879s 2026-09-16T18:27:53.961484Z info Envoy proxy is ready 2026-09-16T18:27:55.260245Z info ads ADS: new connection for node:3 2026-09-16T18:27:55.260397Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:27:55.260475Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:27:55.587874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:28:02.515792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:28:27.028381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:28:32.133066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:28:38.436160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:28:59.959449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:29:20.364751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:30:14.236560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:30:14.208Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 27 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "74777bdc-e93a-4a42-a884-8dc8ee455e31" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:41508 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:30:14.330060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:14.967942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:30:14.294Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 35 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "2c4f588c-2910-4d85-9fb8-12e86840ef0d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:41518 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:14.388Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 523 56 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "0a278685-d4c1-4043-89ad-b3205b2f13ad" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:41534 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.479Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 349 21 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "0033e7eb-21d6-4896-b24a-6c96b0c9a99d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:41536 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.534Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 360 15 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "39087673-059f-4fde-8682-198803de28bc" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:41538 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.574Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 346 15 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "b5d3ecdf-9f85-4e63-b426-2990899e046d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:41544 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.619Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "6dd12654-94a4-4297-837f-86aa858e62f4" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41554 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.663Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "2f9f2928-3362-4be2-8065-a56af6152b48" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41570 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.702Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "79f726e0-4a51-4f0e-ad5b-6efd09090afe" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41580 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.739Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "5367beee-978c-4975-9d0a-011cd8b88c71" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41586 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.802Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "7b297e8b-e526-42aa-b10c-5ebcce0a7c2d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41600 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.838Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "afa18f4c-a4e4-4021-b71f-ea5cfe826087" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41608 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.875Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "535edf79-86e7-4a69-bc2b-01f9decb7432" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41616 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.922Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "8112755e-a81e-4cb9-a66d-69c8ba615760" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41628 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:30:14.953Z] "DELETE /v1/api-keys/78f771f5-d68c-4eb6-a5de-dc907ff1d01d HTTP/1.1" 200 - via_upstream - "-" 0 365 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "53e4e9c8-a7e2-438a-b6fa-bb5f304709a2" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:41636 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:30:15.239196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:15.274610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:30:15.235Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "929bbdc3-6583-4238-ba11-55efe750cf39" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:41640 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:30:15.263Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "be28cd1d-4c25-4e3f-873a-f0706d4927ad" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:41652 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:30:28.077341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.169548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:28.169573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-16T18:30:28.209848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:28.236224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.250480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:28.250627Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-16T18:30:28.290357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-16T18:30:28.293558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.293701Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-16T18:30:28.298947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.480191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.519013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.581124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:28.616593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.699215Z info ads ADS: new connection for node:4 2026-09-16T18:30:28.701695Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-16T18:30:28.701730Z info cache read certificate from file resource=file-root:system 2026-09-16T18:30:28.810226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.847195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.920332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:28.953350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:30:28.072Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "526e42ff-7fd4-4e9a-a56f-9a17291ce234" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:47360 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:30:28.104Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "05325b0b-b62c-4c09-9af1-eb6170ca0220" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.133.0.9:47362 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.155Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8fbfc8c0-482e-4c1a-8d9f-2f10d6220320" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:47366 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.195Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "6bbfb6a3-2712-4dcd-9884-042ba2219f37" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39566 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.222Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "11ad4e5c-a898-4189-b2fd-b3494bb83f10" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39568 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.230Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bee29588-3a15-41ae-816e-11686ae758ed" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:39570 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T18:30:28.258Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 7 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e5e138d5-f728-4f0b-ade8-f5c173440c75" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39582 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.273Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "72ead885-9d0a-4ba4-80bb-0b6583360644" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:39594 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:28.286Z] "DELETE /v1/api-keys/b5a3c66e-8c55-4e74-b9b0-ab1007aaa3a9 HTTP/1.1" 200 - via_upstream - "-" 0 370 12 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "74f43151-2080-4601-8271-dd7d8824cb67" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39596 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.466Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3ff1536c-4083-496c-b823-02d9d089be49" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39610 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.502Z] "DELETE /v1/api-keys/9a0a35fc-d830-4eed-abf9-2b269a713853 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "af813205-b149-408c-bd57-f915f55c2df7" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39616 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.537Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3d28f021-ce65-4794-850c-7fb9180c9301" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39620 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.567Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8f5b9d33-a3a4-4cee-bf2c-77ab7080a6c2" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39634 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.600Z] "DELETE /v1/api-keys/8d717740-19d0-40c3-9339-5ed2407181e7 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "6795d8b4-50f4-4f41-b1e1-d8326105d8d8" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39644 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.795Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "049ea95a-fca4-4efc-a9e6-58aeca072751" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39654 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.832Z] "DELETE /v1/api-keys/ca2624eb-9e19-45ce-a1e7-8aff0d14e428 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "58857cb7-3b2a-4198-b40d-cd84476f89b7" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39666 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.871Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9fc9dd55-1408-4f6e-8be2-a6804b4796a8" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39672 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.902Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e2e47be4-24e1-4bdc-89be-8261da9dd624" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39684 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:28.938Z] "DELETE /v1/api-keys/791beb98-6853-4ede-877d-794c3d18899a HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3407bc8d-eb36-439d-b1f2-987e57fe830b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39690 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:30:29.131955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:29.168842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:29.237607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:29.285529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:29.446527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:29.664894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:29.788998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:30:29.117Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3cb2d355-04b5-4e4f-8589-bbeda4df8a75" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39698 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.151Z] "DELETE /v1/api-keys/7957ab40-a128-454d-a9cf-d9777e1eb801 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "88fdd7a5-8c10-46e0-a29a-0fe8a58a3c7b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39708 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.189Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "4226d114-e861-4da1-8c0a-ae60b33f8ddc" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39720 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.221Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "edb42d45-9097-4381-99b2-0e91c9e6b3b5" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39736 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.259Z] "DELETE /v1/api-keys/b4054153-71d3-4ce7-bc4e-e9307f62a44f HTTP/1.1" 200 - via_upstream - "-" 0 321 25 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a1c8ee76-b93b-9f47-a0f3-7584d9924144" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39740 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.429Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f0a44086-3474-4385-aff7-e863a11f61b9" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39742 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.469Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "47a96195-a8b5-4a96-b2fe-52a861c17211" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39746 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:29.649Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "30ae5f4f-8bc9-4d1c-a92f-f828ab4767d9" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39762 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:29.686Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 21 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e61c7353-d708-4cab-836c-02ddbddbbb1d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:39772 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:29.726Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 20 - "34.228.250.194,10.133.0.9" "-" "614f38c7-9b73-4714-a4f0-4e3c7ba2fac8" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:39784 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:29.772Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "cfcb970b-0fa8-48b7-b761-365df366beab" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:39794 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:30:32.760078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:30:33.742078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:30:33.727Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "623bb1af-181a-4c8a-a138-c34991c84d90" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:39800 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:34.133Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 9 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "29671ea4-e0ee-4458-b8d8-f1ba4ca0977a" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.37:443 10.133.0.9:39812 - llm.e2e-external-model.0 [2026-09-16T18:30:34.165Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "af71e34c-d42b-4fc2-9624-d5264bcf17af" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.37:443 10.133.0.9:39826 - llm.e2e-external-model.0 2026-09-16T18:30:34.490739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:34.490883Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T18:30:34.196Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 294 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "78a611c8-bfd8-41df-bcad-ae57145610fd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:49152 10.134.0.37:443 10.133.0.9:39828 - llm.e2e-external-model.1 [2026-09-16T18:30:34.814Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a4856b9c-b5c8-48f1-aa0d-979b3952cc31" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:39834 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:35.532Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "46f7b677-ea22-4686-a43d-9794ba7e3072" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" - - 10.134.0.37:443 10.133.0.9:39842 - - 2026-09-16T18:30:40.371199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:30:47.175Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 8 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9b1da181-6293-4e81-be0b-7b632baeb17a" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" - - 10.134.0.37:443 10.133.0.9:33476 - - 2026-09-16T18:30:48.470620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:30:49.840610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:30:49.824Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "30cd047f-a2b7-47ae-bc18-ea7c3cb9626a" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:41054 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:49.865Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "da4cb5a4-fcb5-41bd-a75a-d5fab34c5f7b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:41066 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:30:51.973733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:30:51.958Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a9774e62-2d80-412f-b495-43a5202cb577" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46714 10.134.0.37:443 10.133.0.9:41094 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:30:51.993Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 39 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "73c30f2d-ecc8-49ec-82c3-fb0d1b4603c0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:41108 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:52.057Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 21 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "153f65b8-2883-4ce2-9309-8fa33fd82feb" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:41112 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:52.105Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 49 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0d81b19e-3154-4400-898c-a0117ebe81c0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:41120 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:30:52.172Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "fa009804-83e0-445c-aba7-21a7eb2c3af7" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:41128 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:30:53.936295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:30:53.936570Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T18:30:50.927Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 3008 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bab00e17-8317-4d97-b5f2-db09663e9a31" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:39222 10.134.0.37:443 10.133.0.9:41080 - llm.e2e-external-model.1 2026-09-16T18:30:55.049809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:55.049952Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T18:30:53.957Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 1092 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "46e7cd79-d692-4bae-9287-f6023b399dea" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:39232 10.134.0.37:443 10.133.0.9:41140 - llm.e2e-external-model.2 2026-09-16T18:30:57.377681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:30:57.377820Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T18:30:55.070Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 2307 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9ca9449b-f491-4418-a0ad-9b465db18f3c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.37:39232 10.134.0.37:443 10.133.0.9:41152 - llm.e2e-external-model.2 2026-09-16T18:30:58.604269Z info ads ADS: "" 4 terminated [2026-09-16T18:31:08.226Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ff10c93c-92dd-481b-8cb1-40326eb3878b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" - - 10.134.0.37:443 10.133.0.9:51594 - - 2026-09-16T18:31:08.563225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:31:08.709715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:31:08.376Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "962ab237-4e71-4444-a04c-443ab4b8ebb7" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" - - 10.134.0.37:443 10.133.0.9:51610 - - [2026-09-16T18:31:08.528Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ae070f44-a8be-4ffc-8845-d449d70e688d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" - - 10.134.0.37:443 10.133.0.9:51616 - - [2026-09-16T18:31:08.559Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c513eb65-d203-457d-95b7-bc8c7ceddc58" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:51620 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:31:08.697Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c731ae6c-ab12-4518-84ad-a8f5ced4014a" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:46710 10.134.0.37:443 10.133.0.9:51626 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:31:10.577885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:34:45.605178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:35:01.484271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:41:31.391351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:41:50.097811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:49:29.484053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:49:29.466Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8912e694-8032-4e7b-9466-0f18fdb73f19" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:53524 10.134.0.37:443 10.133.0.9:56054 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:49:29.507Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 326 31 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "276b7e87-8db2-420b-911c-04c6ef20fc36" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:56060 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T18:49:29.562Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "79b078ec-8c7d-4dc2-8cc9-08b0598f7070" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:56068 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-16T18:53:18.178511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:53:18.152Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 25 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "70b4f594-bd55-4e55-930d-1f9b1f4e0f93" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58806 10.134.0.37:443 10.133.0.9:58908 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:53:20.288635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:53:20.775817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:53:20.272Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "32c0e8c5-328f-4855-ab44-43759776935c" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:58808 10.134.0.37:443 10.133.0.9:46834 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:54:41.652771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:54:42.027574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:54:42.011Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c84b0ee1-2a03-4dad-a60a-adc27ef44e81" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60926 10.134.0.37:443 10.133.0.9:38286 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:55:05.595927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:55:09.119786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:55:09.103Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "168a84f7-24ff-42a9-8fd1-730df01df6cd" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:47934 10.134.0.37:443 10.133.0.9:57246 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:09.140Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 40 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "66bda6b2-7546-47e9-98e5-21459bbf83d0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:57250 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:09.303Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "250c8d30-2fd6-447b-a7ba-071533bef6ae" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:57260 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:09.441Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d9efc4a5-da72-4a3e-8537-8c4eab29fecf" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:57272 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:09.575Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "54348d03-aad7-4c30-b5c6-da764673571b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:57280 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:09.711Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "54ad1f14-8b8a-40c2-b58a-35bfd623333e" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33262 10.134.0.37:443 10.133.0.9:57296 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:09.846Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a26f9ca6-67cf-49df-88dc-cea055c49e59" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:57308 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:13.361332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:55:18.447660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:55:18.587663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:55:18.433Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "17f11a57-a016-4bc8-b2c5-b295beceaaec" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:47934 10.134.0.37:443 10.133.0.9:37974 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:18.466Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "aa5894b6-5202-4e99-9f00-f1ba020f4ac1" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:37976 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:18.505Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "adcdc804-92d0-4038-a445-bc704c2839b0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:37978 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:18.542Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 12 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bd26ed0b-ad1d-4df4-b3f5-1aaaa1eb0bf5" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:37990 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:18.573Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5a2f952f-cf8e-40f8-b8e9-d85cc6084280" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:37992 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-16T18:55:19.300424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:55:19.286Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d064ba9b-a800-4fe1-8715-5ab2b3edfe81" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:47934 10.134.0.37:443 10.133.0.9:38006 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:19.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a950cf9d-cc64-4c8c-9388-dde37090884f" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:38018 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:20.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "cc1a2281-8886-4489-82c4-33a53d0c217d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:38034 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:20.914Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9bddb056-f325-4e6e-811a-f49aae4e53ac" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:38046 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:22.754834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:55:21.957Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "15125524-43b3-4dba-9213-589d122836fa" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40142 10.134.0.37:443 10.133.0.9:38058 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:26.950940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:55:27.310Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "6753c6d7-cf17-4b28-b1f1-65ab97e646b0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:38062 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:55:32.363Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "6944545a-1cd7-4590-98b1-bfae39307cfa" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:40936 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:33.174634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:55:33.160Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b0700319-fd55-45e0-bac1-52c2d7b1d760" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60926 10.134.0.37:443 10.133.0.9:40946 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:33.517Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bf9135a2-5b65-40da-831a-4b1047ade84f" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:40962 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:41.560919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:55:43.514741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:55:43.499Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "737e269e-b215-41fa-a231-d4dd216eca75" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:47934 10.134.0.37:443 10.133.0.9:59916 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:43.535Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bba51a61-570a-4fd4-94cd-7afe7cf878e4" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:40128 10.134.0.37:443 10.133.0.9:59924 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:44.808784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:55:44.794Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b46f9f99-a96f-4312-916d-95b7211ffc5d" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:47934 10.134.0.37:443 10.133.0.9:59932 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:55:45.145Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "95544b69-1624-429f-9ce5-19f2ccb9893e" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:59938 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:55:47.167013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:56:49.039279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:56:49.021Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "fdf5e730-168c-4d23-82c2-2636ef82c75a" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:56880 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:56:49.061Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "80cc2b42-6c2e-4387-9390-7c778222bbcf" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:56886 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T18:57:09.896057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:57:11.498490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:57:10.881Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 306 32 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a9884c19-a837-4369-9c69-f4bce7add8a5" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.133.0.40:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:51072 10.134.0.37:443 10.133.0.9:56834 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-16T18:57:11.483Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8791012b-24e9-4f19-8077-ebeb709ff12f" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:56846 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:57:13.680129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:57:17.963837Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:57:19.868950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:57:20.012259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:57:19.852Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9c1dca28-61d3-44e8-8dab-8b9e0ad955de" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:44692 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:57:20.000Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "fd4d0b3a-ae45-45f1-8f39-3ae0ea2ce155" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:60906 10.134.0.37:443 10.133.0.9:44704 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:57:23.767196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:57:31.965530Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-16T18:57:40.669558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:57:55.103664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:02.944513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:02.981762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:02.925Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d01f4bd1-7c9d-4739-8219-67cbdadf68a0" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:46050 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:02.970Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0001fd52-f1f0-4476-8455-284771ef2907" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:46060 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:07.668239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:08.270558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:08.306631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:08.255Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "993d9243-6c9d-4c06-9e7e-51827e6f07fe" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:46072 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:08.296Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "26bcef75-9786-4807-9155-a6dd5bba7aa1" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:37694 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:11.973329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:20.321228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:20.358414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:20.536602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:20.296Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 24 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9482c046-13fd-4c87-8b8f-c5744c5fee2f" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:43232 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:20.343Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "940bf336-2583-4230-aa14-43ff4568d037" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:33248 10.134.0.37:443 10.133.0.9:43240 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:20.379Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 21 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "4cec1762-96fd-4545-af16-255037a4b52b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33252 10.134.0.37:443 10.133.0.9:43254 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:20.419Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3a490886-d033-4660-9ac6-b979dbe8a88b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:33262 10.134.0.37:443 10.133.0.9:43264 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:20.458Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "7611d4d4-6d4c-92fa-9675-24ebaa07e938" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:43268 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:20.495Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "476495d0-b0ab-484e-a836-85e96fd02e2b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:43276 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:20.527Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "52d057b8-9465-45a5-ba77-97beca98d79e" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:43258 10.134.0.37:443 10.133.0.9:43278 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:22.779074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:58:27.996Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "78cdac1e-5815-40a7-b742-427255a09bae" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:43286 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T18:58:31.062934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:36.320414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:36.299Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8f9c3e89-4b2a-4afa-b653-d493907d844b" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.134.0.82:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:55818 10.134.0.37:443 10.133.0.9:47498 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:36.339Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 30 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "7ebaa03b-59a9-4dd7-b3d4-9c016c2dc5e5" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:34518 10.134.0.37:443 10.133.0.9:47500 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T18:58:36.489Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "fedc4f31-eb4c-462b-b818-4475091ac422" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:34522 10.134.0.37:443 10.133.0.9:47506 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T18:58:36.630Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d775fd8d-2c84-4d65-bca0-cb6c75d50cce" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:34522 10.134.0.37:443 10.133.0.9:47514 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T18:58:36.771Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "1650d52b-54b5-46b7-8dd8-4d9cc271e0e6" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.37:443 10.133.0.9:47522 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T18:58:38.784951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:44.661281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:58:49.492942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:58:49.471Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 21 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3f506eb4-9778-46c9-8718-1e94f905fc14" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.93:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.37:34842 10.134.0.37:443 10.133.0.9:48382 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:49.512Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "faad6e66-761e-43b8-9176-01c013c653ad" "maas.apps.2b5b85fb-0ab1-4d4d-a2ac-ca8cbd7b54a6.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.37:34518 10.134.0.37:443 10.133.0.9:48396 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T18:58:51.569648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8