2026-09-19T05:49:36.242360Z info FLAG: --concurrency="0" 2026-09-19T05:49:36.242379Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-19T05:49:36.242384Z info FLAG: --help="false" 2026-09-19T05:49:36.242388Z info FLAG: --log_as_json="false" 2026-09-19T05:49:36.242390Z info FLAG: --log_caller="" 2026-09-19T05:49:36.242393Z info FLAG: --log_output_level="default:info" 2026-09-19T05:49:36.242396Z info FLAG: --log_stacktrace_level="default:none" 2026-09-19T05:49:36.242403Z info FLAG: --log_target="[stdout]" 2026-09-19T05:49:36.242408Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-19T05:49:36.242411Z info FLAG: --outlierLogPath="" 2026-09-19T05:49:36.242414Z info FLAG: --profiling="true" 2026-09-19T05:49:36.242417Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-19T05:49:36.242419Z info FLAG: --proxyLogLevel="warning" 2026-09-19T05:49:36.242422Z info FLAG: --serviceCluster="istio-proxy" 2026-09-19T05:49:36.242425Z info FLAG: --stsPort="0" 2026-09-19T05:49:36.242428Z info FLAG: --templateFile="" 2026-09-19T05:49:36.242431Z info FLAG: --tokenManagerPlugin="" 2026-09-19T05:49:36.242434Z info FLAG: --vklog="0" 2026-09-19T05:49:36.242438Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-19T05:49:36.242620Z info Proxy role ips=[10.132.0.37] type=router id=maas-default-gateway-openshift-default-78bb78ff78-5trhr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-19T05:49:36.242681Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-19T05:49:36.243748Z info cpu limit detected as 2, setting concurrency 2026-09-19T05:49:36.243976Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-19T05:49:36.243990Z info JWT policy is third-party-jwt 2026-09-19T05:49:36.243994Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-19T05:49:36.245896Z info Opening status port 15020 2026-09-19T05:49:36.245912Z info Starting default Istio SDS Server 2026-09-19T05:49:36.246540Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-19T05:49:36.246567Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-19T05:49:36.247109Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-19T05:49:36.248481Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-19T05:49:36.249334Z info Starting proxy agent 2026-09-19T05:49:36.249363Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-19T05:49:36.257886Z info sds Starting SDS grpc server 2026-09-19T05:49:36.257913Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-19T05:49:36.304272Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-19T05:49:36.304556Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-19T05:49:36.310511Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-19T05:49:36.396959Z info ads ADS: new connection for node:1 2026-09-19T05:49:36.397414Z info ads ADS: new connection for node:2 2026-09-19T05:49:36.466773Z info cache generated new workload certificate resourceName=default latency=219.490236ms ttl=23h59m59.533230599s 2026-09-19T05:49:36.466809Z info cache Root cert has changed, start rotating root cert 2026-09-19T05:49:36.466844Z info cache returned workload trust anchor from cache ttl=23h59m59.533156397s 2026-09-19T05:49:36.466861Z info cache returned workload certificate from cache ttl=23h59m59.533139323s 2026-09-19T05:49:36.467170Z info cache returned workload trust anchor from cache ttl=23h59m59.532833607s 2026-09-19T05:49:36.467952Z info cache returned workload trust anchor from cache ttl=23h59m59.532049489s 2026-09-19T05:49:36.510745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:49:43.024254Z info Readiness succeeded in 6.784126719s 2026-09-19T05:49:43.024532Z info Envoy proxy is ready 2026-09-19T05:49:51.806449Z info ads ADS: new connection for node:3 2026-09-19T05:49:51.806606Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T05:49:51.806633Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T05:49:52.052527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:50:09.454084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:50:24.574066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:50:37.271089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:50:46.185252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:50:53.711176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:51:06.207227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:53:13.462006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T05:53:13.432Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 29 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "0da47e66-598d-44aa-8b73-48916086d115" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:55292 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:53:13.554990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T05:53:13.507Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 47 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "55215f8b-7731-4285-a62f-fdac94458890" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:55294 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:13.615Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 340 63 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "f894c5b7-2be3-4d4c-8574-ab8a3cbd1f2b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55296 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:13.723Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 346 17 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "c1af6011-d3af-407b-98af-c065ceab9115" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55300 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:13.776Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 523 16 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "34c1643f-b155-4767-979c-ce504a156bfa" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55312 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:13.824Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 388 16 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "b4fedd20-ca6a-4647-81a3-34d831666309" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55322 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-09-19T05:53:14.049875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-19T05:53:14.216394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:14.490730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:14.529876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T05:53:13.874Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 16 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "3d63eace-8f48-4060-900e-175709e78bb3" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55336 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:13.925Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "2b363d2f-fab5-4fd1-b0f1-d6c18ee64995" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55348 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:13.963Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "0411ec3a-a9ed-4e90-96d1-f758f4971010" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55350 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.000Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "b16eb8d1-02e1-440a-aae6-1303529168e0" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55352 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.036Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "b73f42da-4438-49e8-bf7b-479d4f14535b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55364 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.075Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "27dd0eb6-ecba-4647-a5f9-ea8ba7c2b088" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55368 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.112Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "cf8112fc-6d35-479d-a50c-0d69916c205c" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55384 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.159Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "5be6ea06-2eb1-41f2-81c1-82f2f0229994" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55392 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T05:53:14.200Z] "DELETE /v1/api-keys/21444b6c-bbe1-4817-8017-8aa68f02692b HTTP/1.1" 200 - via_upstream - "-" 0 365 16 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "306c9c71-bd54-4885-8afc-1fceb436a01d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:55404 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:14.487Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "0b0a73dc-3937-420c-b349-842deddd6aeb" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:55414 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T05:53:14.517Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.133.0.8" "curl/7.76.1" "2b047aa2-6b24-4959-9937-481a77d69398" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:55420 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:53:24.197707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.262320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.302322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.340973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:24.342769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.342916Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T05:53:24.387343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.387498Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T05:53:24.401174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:24.585592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:24.624209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:24.690487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.735327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:24.777791Z info ads ADS: new connection for node:4 2026-09-19T05:53:24.780869Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-19T05:53:24.780909Z info cache read certificate from file resource=file-root:system [2026-09-19T05:53:24.193Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "740881c3-b067-456e-a47f-a25b06ce8172" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41498 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T05:53:24.218Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "806f038d-1658-4f8e-bfc7-7d52aa16a977" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41506 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.250Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "242e53b6-9274-4dde-b0bc-645630b11324" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41516 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.288Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "35739fd9-154e-95c2-8131-18e1f6005f4d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41532 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.327Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "30359eb3-c7fc-4e36-8ffd-e99652c56e7c" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41554 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.321Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 21 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "bbc22a8e-0747-4030-80c9-af28a10af736" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:41546 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T05:53:24.358Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 8 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "531bfcac-d86f-4462-82b5-53182a408ffe" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41570 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.370Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 17 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b69a2c15-8dfa-4686-ab08-bfe4f1270107" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:41576 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:53:24.386Z] "DELETE /v1/api-keys/64cf9315-352e-422c-88a4-f4dca6a739d5 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "ef5da1f5-820c-4c50-91fd-b447fd2b7eb6" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41586 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b36db9b6-ce02-4281-a4d4-29a9464240d5" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41590 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.610Z] "DELETE /v1/api-keys/061d7d9c-8eee-4841-a807-b4b3f66d2f6b HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "44d47904-849a-4c50-a8ad-a36a8f593e94" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41602 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.647Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e1a30b7b-e554-4b68-b57c-a3bc1cd2c548" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41606 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.677Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6368d0c3-9fc2-475f-8b67-b53410d16e09" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41614 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.721Z] "DELETE /v1/api-keys/63adeadb-5098-4aa1-b078-d5e0a0430ef5 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "f8096a05-614b-4b4c-b533-c9f57356731b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41618 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:53:24.941002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:24.977687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:25.045608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:25.079450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:25.246708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-19T05:53:25.257691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:25.294335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:25.366015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:25.409775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:25.584656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:25.787974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T05:53:24.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e3e9122c-d3f8-4151-9768-e3cefd8305da" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41620 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:24.961Z] "DELETE /v1/api-keys/47a46041-32ce-4ffb-8013-8930e6b7eee9 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9814b4b4-77e5-4fd0-aa22-04deaf032916" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41626 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.000Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "1aa384e8-5865-4d3b-be8a-b86ae45c6344" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41632 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.030Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "1d6be839-59e1-4d46-80f9-554bbb35407c" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41644 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.064Z] "DELETE /v1/api-keys/665778c0-939f-433d-aabe-6dc8bf459ae4 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "40ecbe1d-2a39-42c8-aad9-fc9d6bbeb06a" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41656 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.240Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6aa213eb-b408-487b-9f29-fe16f1fed0f6" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41666 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.277Z] "DELETE /v1/api-keys/b75a9c23-0862-4d5a-a6a2-3a54d82e491f HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "fefbba3a-bb47-9584-995b-61be839eef68" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41680 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.314Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "8c5c4476-f238-4007-abde-68025f4fef17" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41686 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.349Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "d69e4ac5-2a90-4ba8-af02-b152ebc2dd4b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41694 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.391Z] "DELETE /v1/api-keys/7c364ae5-cdb2-41c5-ae98-7ede78887603 HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6e969b92-6051-4bea-918c-9104a9b4d5f9" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41702 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.569Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "efd5ae66-91be-4525-8f90-d1daafa0adcc" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41718 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:25.605Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 12 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "273ae96f-2d90-4e63-9d3f-1e73adb37456" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:41726 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:53:25.771Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "aec7682c-4b7f-476b-a405-083f1d7cb189" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:41734 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:53:30.359764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:53:31.900154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T05:53:31.885Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3a7a1a3c-5f80-45e6-b103-e3dfe69e72a0" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:41750 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:53:32.400410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:32.400555Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-19T05:53:32.266Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "19a8cc02-10ca-4f3c-92f1-731502b02195" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.37:443 10.133.0.8:54052 - llm.e2e-external-model.0 [2026-09-19T05:53:32.298Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3188a14d-f53a-4913-a30a-9ec351474fba" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.37:443 10.133.0.8:54066 - llm.e2e-external-model.0 [2026-09-19T05:53:32.324Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 75 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "4d2549f4-3ee6-4c77-a1b3-cc90267f700a" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.37:60020 10.132.0.37:443 10.133.0.8:54072 - llm.e2e-external-model.1 [2026-09-19T05:53:32.476Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9db7e23b-b122-4a48-85ce-5c4800137eff" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" - - 10.132.0.37:443 10.133.0.8:54076 - - 2026-09-19T05:53:33.924563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T05:53:33.818Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 24 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "1c15d1a4-12ea-43d6-b71b-6ee1b9c5443f" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:54080 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:53:33.859Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 21 - "52.71.36.72,10.133.0.8" "-" "29471789-137d-44d7-82d8-f3a367a128d6" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:54096 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:53:33.904Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "d1018172-8cf4-42b8-b14e-3c56469e3baf" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51086 10.132.0.37:443 10.133.0.8:54108 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:53:38.950Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 12 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "179da77e-1082-4721-b411-679d940119b4" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:54124 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T05:53:39.200463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T05:53:45.086Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 6 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "2cc8ae65-0a3c-40a9-9286-3e6e07f83ff2" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" - - 10.132.0.37:443 10.133.0.8:43958 - - 2026-09-19T05:53:48.900742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:48.900925Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T05:53:49.000409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:53:49.000585Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-19T05:53:48.828Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 72 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e8df63fa-cbe0-44e1-b9e9-471c9a5aeb86" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.37:55932 10.132.0.37:443 10.133.0.8:43968 - llm.e2e-external-model.1 [2026-09-19T05:53:48.932Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 68 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "98e9f63a-833e-4e74-bf92-f1482a928124" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.37:55932 10.132.0.37:443 10.133.0.8:43980 - llm.e2e-external-model.2 2026-09-19T05:53:49.279936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T05:53:49.280154Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-19T05:53:49.021Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 258 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "567e34a5-3b2d-45bf-89c4-061c833dd8ba" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.37:55948 10.132.0.37:443 10.133.0.8:43990 - llm.e2e-external-model.2 2026-09-19T05:53:50.522311Z info ads ADS: "" 4 terminated with stream closed 2026-09-19T05:53:51.209797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:54:06.377407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:54:06.716272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T05:54:06.701Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c5c44e7b-6a8c-4b51-ab25-1854446d1f30" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:51162 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:54:06.743Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 25 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "2b099efe-84f8-4418-bcd9-a1d78147e71b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:51178 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T05:54:08.713909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T05:54:08.691Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 22 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c98940d8-ebbe-4b8c-87e3-b50ac0aeceb0" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:51192 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T05:54:08.746Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 25 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c88eff84-9b44-4bf6-ab97-5f6ee00dda16" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:51196 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:54:08.793Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "a3887d46-6e6c-4335-887e-9523d6bb8405" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:51200 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:54:08.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 31 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "45e31294-e997-48de-b006-65d98f826672" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:51206 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T05:54:08.888Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 17 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "390c7621-1563-4a03-83f5-ac39732fa4e8" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:51220 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T05:54:23.188166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T05:54:23.347945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T05:54:22.786Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 7 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "a9289a2d-bb33-4bba-b70d-03c363fff419" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" - - 10.132.0.37:443 10.133.0.8:45026 - - [2026-09-19T05:54:22.995Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "eddde053-5af4-45a1-9bdd-d9a794e0aa78" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" - - 10.132.0.37:443 10.133.0.8:45028 - - [2026-09-19T05:54:23.156Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "53f60b32-b9de-4daf-9152-8774ad2dbd48" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" - - 10.132.0.37:443 10.133.0.8:45044 - - [2026-09-19T05:54:23.184Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3da00db3-37b6-4854-8c2d-a51feac18b0d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:45050 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T05:54:23.334Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "0bb187a2-86f5-454a-bd77-d680a05f084b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:51070 10.132.0.37:443 10.133.0.8:45060 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T05:57:46.136914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T05:58:04.958514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:04:21.447634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:04:34.621433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:12:12.765746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:12:12.740Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 25 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "059bf118-aed9-4c86-999d-95a1982ba3eb" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:54734 10.132.0.37:443 10.133.0.8:49710 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:12:12.788Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 31 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "1183097c-24ba-4b84-9c96-6e380165f433" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:49714 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T06:12:12.842Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 19 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "998e2227-96af-453f-ae07-1dd409bd6189" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:49724 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-19T06:15:36.313930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:15:36.296Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 17 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "762b83e9-1b4e-4def-8e1a-2478319244f8" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:33092 10.132.0.37:443 10.133.0.8:58800 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:15:38.565845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:15:38.551Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e8b761c4-0084-439e-8f1c-7315e77edf8b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:33092 10.132.0.37:443 10.133.0.8:58810 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:15:39.708101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:17:03.417765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:17:04.195471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:17:04.180Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "60da16a4-6b67-463c-bd5e-c2c2159b32ac" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:41986 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:17:17.447601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:17:17.422Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 25 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "01c3a6bd-c7ef-4bd1-b488-5b9f744a70af" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:34260 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:17:28.121Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 33 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6e450f19-8332-4385-8004-5a8ebeca845f" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:43034 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:28.174Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3bdeb136-58bb-45cb-accd-4315f0f1b00d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:43050 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:28.218Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c89aefbf-a509-466f-a2f3-8ebf502db336" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:43056 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:28.261Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 9 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "70b59497-9af6-494b-bc5f-8a6dfe7e2993" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:43068 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:28.290Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c562aea7-79e0-461b-be23-f1b0dbe17784" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:43072 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:28.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "f65b3db6-9de1-44d4-81c1-0617c91326b3" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:43088 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:17:53.615601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:17:58.888715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:17:58.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "0cd9c89b-902b-4ce7-9eeb-9243e01c2d7e" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:38934 10.132.0.37:443 10.133.0.8:57976 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:17:58.909Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 31 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "232c95b4-c444-4841-8ad8-ee8a313483ac" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:57978 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:59.065Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3278e2bc-bc1d-4fed-a350-a4445ced0060" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35822 10.132.0.37:443 10.133.0.8:57984 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:59.207Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3cfc07af-6714-4fcc-9245-bc84b55ed15e" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35822 10.132.0.37:443 10.133.0.8:57986 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:59.345Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "0aa2b8e4-09b7-42c7-af77-7d8dba344329" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:57990 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:59.489Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "529c6f90-0404-45ba-a8dd-7bca831ec805" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:58004 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:17:59.645Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "7c2c37fb-e804-4ec5-a8db-b5f5ad944584" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:58010 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:03.000748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:18:07.211754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:18:15.570104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T06:18:15.742265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:18:15.554Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9ebfd31f-158c-44f7-81a6-43a7599aed8d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:55038 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:18:15.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6a9a5acd-1dfe-4499-807c-9f077c150801" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:55054 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:15.633Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "896e1a30-3e09-462f-89f2-afe24135d07b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55066 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:15.694Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6689248a-541a-4169-b9d8-d0b943aca350" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:55078 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:15.727Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "cacdd709-11ac-40e5-9707-335aedaf9d7f" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:55092 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-19T06:18:16.473548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:18:16.459Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "ca1cf439-0276-41ce-8820-90f41b5ff4ff" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:55102 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:18:16.494Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "4ac1926b-12a2-4772-8534-1baee01c3387" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:55106 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:17.439Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "fa935059-bf1b-4a05-9d25-a4bcb6b33181" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55110 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:18.791354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T06:18:18.206Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "8fae8937-57f9-45ec-8379-9768b44ddffa" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:55126 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:19.287Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 19 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "4c818eef-b8c8-4bd2-81a6-ddaaf2b38ad7" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:42966 10.132.0.37:443 10.133.0.8:55134 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:22.092353Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 [2026-09-19T06:18:24.691Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "0db65f7b-1f5d-48ad-9e50-89a18ecc6ead" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:35790 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:18:27.689Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b4e7f5f0-50b8-415e-939b-b44848325b67" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:35792 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:28.521017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:18:28.506Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "ae793730-100f-450f-bac4-932b9b50ee7d" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:35806 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:18:28.897Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "a4e1e893-6350-4266-b6a7-47ecd397dd64" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:35810 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:31.515866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:18:35.624942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:18:36.901639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:18:36.886Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9f24da95-d544-4834-a840-ed4240a54ac6" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:47176 10.132.0.37:443 10.133.0.8:37042 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:18:36.921Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 19 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6284299e-29bc-4281-b6b6-61418eb9afca" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60312 10.132.0.37:443 10.133.0.8:37054 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:38.227787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:18:38.213Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 321 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "92dcc6b6-9cf1-4589-8489-fc114e93bd6b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:38934 10.132.0.37:443 10.133.0.8:37060 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:18:38.587Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "f1806f4e-7362-4a5b-b9c3-7462fa6a869c" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:37068 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T06:18:39.825419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:19:46.750900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:19:46.734Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b5680338-a39d-4205-bcc3-f670eb814623" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:39730 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:19:46.773Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 21 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "94549517-7111-4c51-a504-f94d993eaac9" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:39744 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-19T06:20:09.519160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:20:11.061102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:20:10.420Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 32 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "6cf69980-94df-41e7-a720-39bf9225da5a" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:47084 10.132.0.37:443 10.133.0.8:54140 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-19T06:20:11.047Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b285a1c1-bce2-4f83-be48-fb0421576f10" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:54148 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:20:13.607579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:20:17.910943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:20:19.517344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:20:19.501Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "af386654-1d62-47e7-9ef8-341a0c6c8a13" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:58080 10.132.0.37:443 10.133.0.8:41918 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:20:19.670074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:20:19.658Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9a0b914d-6efa-4a39-8e5e-c3940e4fc6dc" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:41930 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:20:22.402879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:20:37.406496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:20:51.824015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:13.154516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T06:21:13.190585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T06:21:13.138Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e6a7d730-9662-4e6a-acc0-aaab30453ab4" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:54922 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:13.179Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b8d4c71f-5b66-4a4e-8982-0498a7015446" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:54934 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:21:18.101699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:19.807810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T06:21:19.842792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:21:19.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "751919d2-47e9-41f8-b0be-11433018acae" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:36550 10.132.0.37:443 10.133.0.8:54944 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:19.831Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "a855046c-c63d-4faa-8f7e-b1d358cb4999" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:57604 10.132.0.37:443 10.133.0.8:54956 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:21:23.694674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:31.890281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T06:21:31.924890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T06:21:32.080075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:21:31.873Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "3408444c-d8e1-4c49-b97b-c8c1af7a6cec" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:57604 10.132.0.37:443 10.133.0.8:45922 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:31.913Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "4c768289-fd35-421b-b768-2f8ad125a6b6" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:57604 10.132.0.37:443 10.133.0.8:45934 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:31.948Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 20 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "63c8de1e-fa4c-4e9b-95c0-bfbcc9db050f" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:35812 10.132.0.37:443 10.133.0.8:45938 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:21:31.988Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "c98546c0-5221-4e3a-ab09-0e8ad223d930" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:45948 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:21:32.026Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "5e53e4cb-98f4-40c2-a696-20292a8fe940" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:45954 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T06:21:32.069Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "41fdd029-3ecb-463a-976e-96175b6d59ea" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:57604 10.132.0.37:443 10.133.0.8:45956 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T06:21:34.209065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T06:21:39.700Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 16 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "421c17ef-3fe7-4c62-a69f-eaf10722f23e" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:48388 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T06:21:42.412219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:45.759081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:21:45.743Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 15 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "04105dc8-f2b0-4424-982b-80f3606b549b" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:57604 10.132.0.37:443 10.133.0.8:53220 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:45.784Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 32 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "a08d5d19-5312-4b24-902a-9bed32994a16" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:49154 10.132.0.37:443 10.133.0.8:53234 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T06:21:45.941Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "9f770504-acaf-49ad-96d4-dd19ed53057c" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:49154 10.132.0.37:443 10.133.0.8:53236 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T06:21:46.080Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "b0375210-cf34-402a-a39e-aa1bca71feb7" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:49154 10.132.0.37:443 10.133.0.8:53246 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T06:21:46.218Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 14 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "dbb2ea6d-6db0-45a7-8eac-f18326bd4440" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 10.133.0.8:53260 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T06:21:48.505201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:54.503360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T06:21:58.827976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T06:21:58.806Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 21 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "fd37c1e3-0c2d-47c7-b5f2-68179b0931d8" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.132.0.68:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.37:54454 10.132.0.37:443 10.133.0.8:57890 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T06:21:58.851Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 34 - "52.71.36.72,10.133.0.8" "python-requests/2.32.5" "e49f9603-b400-4c65-b3d5-40fcba119bd3" "maas.apps.381adc30-0d61-48d2-8dcb-77fed1b0737c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:44300 10.132.0.37:443 10.133.0.8:57904 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T06:22:02.096284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9