2026-09-12T00:30:21.615355Z info FLAG: --concurrency="0" 2026-09-12T00:30:21.615377Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-12T00:30:21.615382Z info FLAG: --help="false" 2026-09-12T00:30:21.615385Z info FLAG: --log_as_json="false" 2026-09-12T00:30:21.615389Z info FLAG: --log_caller="" 2026-09-12T00:30:21.615392Z info FLAG: --log_output_level="default:info" 2026-09-12T00:30:21.615395Z info FLAG: --log_stacktrace_level="default:none" 2026-09-12T00:30:21.615402Z info FLAG: --log_target="[stdout]" 2026-09-12T00:30:21.615407Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-12T00:30:21.615410Z info FLAG: --outlierLogPath="" 2026-09-12T00:30:21.615413Z info FLAG: --profiling="true" 2026-09-12T00:30:21.615417Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-12T00:30:21.615419Z info FLAG: --proxyLogLevel="warning" 2026-09-12T00:30:21.615423Z info FLAG: --serviceCluster="istio-proxy" 2026-09-12T00:30:21.615426Z info FLAG: --stsPort="0" 2026-09-12T00:30:21.615429Z info FLAG: --templateFile="" 2026-09-12T00:30:21.615432Z info FLAG: --tokenManagerPlugin="" 2026-09-12T00:30:21.615435Z info FLAG: --vklog="0" 2026-09-12T00:30:21.615439Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-12T00:30:21.615654Z info Proxy role ips=[10.132.0.31] type=router id=maas-default-gateway-openshift-default-78bb78ff78-svr8q.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-12T00:30:21.615728Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-12T00:30:21.616834Z info cpu limit detected as 2, setting concurrency 2026-09-12T00:30:21.617158Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-12T00:30:21.617176Z info JWT policy is third-party-jwt 2026-09-12T00:30:21.617181Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-12T00:30:21.619420Z info Opening status port 15020 2026-09-12T00:30:21.619435Z info Starting default Istio SDS Server 2026-09-12T00:30:21.619460Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-12T00:30:21.619490Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-12T00:30:21.620490Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-12T00:30:21.621780Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-12T00:30:21.622547Z info Starting proxy agent 2026-09-12T00:30:21.622577Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-12T00:30:21.630885Z info sds Starting SDS grpc server 2026-09-12T00:30:21.630906Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-12T00:30:21.677325Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-12T00:30:21.677633Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-12T00:30:21.682998Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-12T00:30:21.771273Z info ads ADS: new connection for node:1 2026-09-12T00:30:21.772483Z info ads ADS: new connection for node:2 2026-09-12T00:30:22.271135Z info cache generated new workload certificate resourceName=default latency=650.37271ms ttl=23h59m59.728869065s 2026-09-12T00:30:22.271174Z info cache Root cert has changed, start rotating root cert 2026-09-12T00:30:22.271212Z info cache returned workload trust anchor from cache ttl=23h59m59.728788813s 2026-09-12T00:30:22.271230Z info cache returned workload certificate from cache ttl=23h59m59.728770407s 2026-09-12T00:30:22.271319Z info cache returned workload trust anchor from cache ttl=23h59m59.728685804s 2026-09-12T00:30:22.271604Z info cache returned workload trust anchor from cache ttl=23h59m59.728397451s 2026-09-12T00:30:22.314243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:30:28.590870Z info Readiness succeeded in 6.977641373s 2026-09-12T00:30:28.591148Z info Envoy proxy is ready 2026-09-12T00:30:36.378786Z info ads ADS: new connection for node:3 2026-09-12T00:30:36.378918Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-12T00:30:36.378941Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-12T00:30:36.715519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:30:40.424355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:30:44.118918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:30:55.026257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:31:07.436916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:31:15.446032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:31:35.571598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:33:03.995801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:33:03.966Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 29 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "8f02541b-2726-437e-85cd-520b003bc2d6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:49350 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:33:04.087805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:04.048Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 39 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "8181730c-e7d3-4016-8441-ecafba179f60" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:49358 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:04.159Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 358 56 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "aa9a4f5b-a875-49f9-a9eb-e011b1deae5b" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:49366 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-09-12T00:33:04.773795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:05.045515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:05.079321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:04.276Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 447 16 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "5d2962b2-8835-464d-abf7-2328f51fbcc2" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:49368 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.323Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 370 15 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "17c181b5-1945-49d4-a4ba-061f31415508" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:49382 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.372Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 416 19 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "9b87c333-9d4f-4232-9df8-2b41ceeb7cb8" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:49384 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.423Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "36b731e0-34df-442c-8e6b-411da4878292" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49394 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.475Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "c3caf35a-991b-4269-822a-46ec6af20c77" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49396 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.522Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "0cb1e1c9-405d-4c0a-9fb6-0a268ee8a499" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49408 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.561Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "2a11486e-5e27-4ce4-8d14-89d925e3a4c0" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49410 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.609Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "f0e57af0-c386-427a-bab0-4d67cf9888a6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49426 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.647Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "fc1fea0d-588c-40a3-81aa-f4d0b05db6a4" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49436 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.693Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "ecdb50e5-12f1-43cc-bc07-b8f56a012a15" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49450 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.731Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "7f7e8faa-afb5-4066-bb9b-32efdd228be7" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49458 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-12T00:33:04.760Z] "DELETE /v1/api-keys/3393aaae-ef81-43d1-9656-6b0d4d093497 HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "e67552d9-8038-42f8-9a2d-d68c8453173e" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:49472 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:05.041Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "eb6a947b-5173-472c-8aef-8705933e98ea" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:49482 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-12T00:33:05.068Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "b9cb97af-0505-4d05-9c3e-3977c8c35501" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:49486 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:33:14.657364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:14.684185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-12T00:33:14.720698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:14.759195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:14.796005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:14.798329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:14.798472Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-12T00:33:14.833762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-09-12T00:33:14.835763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:14.835927Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-12T00:33:14.880730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.071033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.104518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.170087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:15.207196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:14.653Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "96c37c13-e453-4346-b6e0-81d60d261e18" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60230 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-12T00:33:14.680Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "256c7c51-4185-41fc-ad9b-20a2a0c9864b" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.10:60244 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:14.709Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 11 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e3138fb1-069a-9e61-bfb8-1a2992cb178c" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:60252 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:14.746Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "56be7b4c-7ee9-4bd0-9256-b09f83c953f5" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60266 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:14.782Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c3fa1ff7-f93b-4079-9bb3-ff0143c24af1" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60292 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:14.781Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e20f9e17-1c87-42d5-8c9d-653b9a931dfd" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:60276 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-12T00:33:14.814Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 7 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "41f9776e-772d-48b3-a780-b87db9661493" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.10:60306 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:14.819Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e7c55f5c-3a4c-4be5-809c-ae5dc8265710" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:60310 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:14.868Z] "DELETE /v1/api-keys/e7b16e68-5859-4aa9-b4b6-c042ce44afe1 HTTP/1.1" 200 - via_upstream - "-" 0 370 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "95c02f1a-9ab8-40cd-831b-829f05d72614" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60316 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.055Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b0428930-054a-43e8-84be-ae3cd9987cf7" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60328 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.091Z] "DELETE /v1/api-keys/e1f5d561-0a5a-4f44-b54e-cf80075851cd HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "89b40e94-1263-40a2-b205-024a6787029f" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60344 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.125Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d6005ee2-278f-42d9-ba7c-2dc8d32ee8cb" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.10:60352 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.156Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "adb0d14e-c428-45cd-acde-ee5391e36652" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:60360 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.193Z] "DELETE /v1/api-keys/d2f2ee6a-2055-4eb6-a620-aed983938744 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c34a93db-be6c-409f-adf3-4f8420bfac80" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60370 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:33:15.305367Z info ads ADS: new connection for node:4 2026-09-12T00:33:15.307889Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-12T00:33:15.307931Z info cache read certificate from file resource=file-root:system 2026-09-12T00:33:15.395155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.429139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.505971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:15.553581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:15.732031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:15.937152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:16.056487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:15.378Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "01a50372-10d7-40b6-9377-4724b5ef1169" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60386 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.415Z] "DELETE /v1/api-keys/c908cc66-6c48-49d9-8897-0c670bbbcefe HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "3384ad34-8f6f-4e48-9138-9c8e25819ac2" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60398 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.451Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "9f29ebe2-e0b6-45af-8a5c-a24cc74d53f1" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.132.0.10:60414 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.489Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "eca4a380-df0b-402d-92cc-e606a63b3541" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60420 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.535Z] "DELETE /v1/api-keys/2e79fb7c-2b82-4a48-af6d-3988ccfa7c4d HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "25448538-d545-4bbd-885e-b39dd8f2de86" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:60430 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.715Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "faecc191-bfd0-9e8b-8b11-b7ba35c26174" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:60440 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.753Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "77f8e924-7f6a-4893-b8f5-742470dc4dbc" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:60444 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:15.923Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "823101db-9f4d-4c5d-bf2a-90d660fff4fc" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60450 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:15.955Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "90219c3d-320c-457a-beb7-572f4505ef03" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:60454 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:15.995Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 17 - "52.71.36.72,10.132.0.10" "-" "c6af07a0-0ca6-4680-8d51-e7921aa5e1d7" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:60464 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:16.043Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "5b5716f0-526c-47b1-9ebb-3982f385de84" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:60472 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:33:19.916697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-12T00:33:21.082Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b44e87cf-49ae-4642-86dc-99fbdeccf7f6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:55592 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:33:22.320182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:22.306Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "508662e0-cb4c-4069-89c1-a3a0116e989c" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:55608 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:22.708Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b45d1341-0f26-490a-a54c-a2e4997acd1d" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.31:443 10.132.0.10:55612 - llm.e2e-external-model.0 2026-09-12T00:33:22.858081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:22.858229Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-12T00:33:22.755Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "51054181-16ae-4a49-ab6f-149bc1402737" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.31:443 10.132.0.10:55626 - llm.e2e-external-model.0 [2026-09-12T00:33:22.790Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 68 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "31c52db2-322c-42bf-a219-fd9633e49fdd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:47576 10.132.0.31:443 10.132.0.10:55632 - llm.e2e-external-model.1 [2026-09-12T00:33:23.271Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 8 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "000cc2e4-995d-4e58-97f5-970f938ce060" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.132.0.10:55634 - - 2026-09-12T00:33:27.528977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-12T00:33:35.573Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 7 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "30f2c739-fd19-433b-9404-aff1b7e1e8c2" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.132.0.10:50462 - - 2026-09-12T00:33:37.301479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:33:38.273450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:38.208Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 65 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "7c8a1baa-b538-4edd-8696-a4dacd5b1609" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:50464 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:38.298Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "bab4d9e9-26b6-4c6b-8f4d-8f3d1e8f2e72" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50474 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:33:39.437251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:39.437476Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-12T00:33:39.335Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 101 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "61884034-4b8d-45ad-8afd-babfca64df83" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:43496 10.132.0.31:443 10.132.0.10:38866 - llm.e2e-external-model.1 2026-09-12T00:33:39.560194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:33:39.560500Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-12T00:33:39.728164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:39.728499Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-12T00:33:39.472Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 87 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "5aa13a95-523c-43b5-b851-d6f843ea0887" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:43498 10.132.0.31:443 10.132.0.10:38874 - llm.e2e-external-model.2 [2026-09-12T00:33:39.594Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 133 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d17a039e-02f5-4f1f-a26e-e8280a1a22b3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:43496 10.132.0.31:443 10.132.0.10:38888 - llm.e2e-external-model.2 2026-09-12T00:33:40.922689Z info ads ADS: "" 4 terminated 2026-09-12T00:33:42.517923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:33:42.419Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 98 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "070119e1-8811-4c4d-9388-748d33a56459" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:38892 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:33:42.539Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 83 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "1e55be6f-5648-4189-b428-46296654be20" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:38898 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:42.640Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 76 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b0ea4b63-9601-4f9f-8dfc-068df8e6b862" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:38910 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:42.737Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 70 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "1f4ce28d-531b-4c4c-bfed-26049571d150" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:38924 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:33:42.829Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 81 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d6ae70cc-b508-4fb0-bb35-56f99792660b" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:38940 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:33:46.026038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:33:56.040413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:33:56.196173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:33:55.692Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "54119631-99fd-4c38-a1d3-4b0575b57c9f" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.132.0.10:46732 - - [2026-09-12T00:33:55.838Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 4 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "64c64c70-d27b-455e-91f0-2aa32836bc63" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.132.0.10:46740 - - [2026-09-12T00:33:55.987Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 7 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "5c11a2f6-1d46-43c5-b6e3-abf7dd7d77d9" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.132.0.10:46748 - - [2026-09-12T00:33:56.036Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "8103b8b1-9938-427a-a335-b585ecf22998" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44254 10.132.0.31:443 10.132.0.10:46760 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-12T00:33:56.183Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "307387e0-1158-488d-9c79-0b3dd32a8525" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:44270 10.132.0.31:443 10.132.0.10:46766 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:38:00.695107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:38:11.493841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:43:24.156462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:43:37.809013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:49:52.877004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:49:52.862Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "789f979e-7c66-4def-a851-5ef4a7769cf8" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:39642 10.132.0.31:443 10.132.0.10:46710 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:49:52.901Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 30 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "82912f35-c518-430f-8d1d-b86dd534ce6f" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:46726 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-12T00:49:52.957Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 318 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f6a62fd7-a22d-4599-b740-39cf2e953200" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:46740 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-12T00:53:33.071770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:53:33.046Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 24 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "ac43ebae-0fc6-44e2-b379-387632deb17d" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:47432 10.132.0.31:443 10.132.0.10:38398 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:53:34.639437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:53:34.624Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "90e42009-018c-444f-a9ea-231b6e4ff7bf" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:47448 10.132.0.31:443 10.132.0.10:38406 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:53:36.061536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:54:56.765895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:54:58.164008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:54:58.149Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e8386996-d4de-4481-938f-c79c5ce81872" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48904 10.132.0.31:443 10.132.0.10:34400 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:55:23.253158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:55:26.778864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:55:26.762Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e51eeb27-68b7-4b42-bf4c-2d4a06b5eb07" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48904 10.132.0.31:443 10.132.0.10:41864 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:55:26.804Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 43 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "a1ff41ce-fe01-497c-8b57-2c4da813903a" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59338 10.132.0.31:443 10.132.0.10:41878 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:26.967Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "faca4bd7-ef06-4a00-9d95-cd2eef9cdc58" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59338 10.132.0.31:443 10.132.0.10:41884 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:27.102Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "076cb2d3-1152-4d90-ae47-061155f4b0d3" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59348 10.132.0.31:443 10.132.0.10:41896 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:27.244Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c66cccf8-2a7d-4788-b74b-cf50f8a66d59" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59348 10.132.0.31:443 10.132.0.10:41902 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:27.383Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f773b9d1-342b-458b-bd19-5dff8ef52b24" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59338 10.132.0.31:443 10.132.0.10:41906 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:27.522Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "3ac288b6-75ff-426d-97cb-68d7f7a523d8" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:41916 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:55:30.968538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:55:35.156936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:55:42.457678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:55:42.605751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:55:42.439Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "2c36beca-0c91-42b9-a683-9e18c1f0cbef" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38222 10.132.0.31:443 10.132.0.10:58472 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:55:42.483Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 19 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "85baca47-1bca-4f80-a8b5-5051163231ce" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59338 10.132.0.31:443 10.132.0.10:58484 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:42.520Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "3edc68e0-2823-4dac-890b-756e9368a2f6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:58498 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:42.559Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f85af53d-c676-458f-8c5a-1e4aa79ce688" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:58504 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:42.592Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "490e5cb9-b8bb-4832-81a4-a4860238b023" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59348 10.132.0.31:443 10.132.0.10:58510 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-12T00:55:43.354692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:55:43.340Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "7755989f-d00d-4cf6-8888-5d1424db88d1" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48904 10.132.0.31:443 10.132.0.10:58526 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:55:43.372Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "5dad1e4a-2121-47e9-bcc7-1e7ac58078f4" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:58542 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:44.340Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "1d9dc7a2-6a7d-4ac0-a97e-012417b54651" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46650 10.132.0.31:443 10.132.0.10:58550 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:55:45.485400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-12T00:55:45.082Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "dd8700b1-d1a2-42b9-b2ab-a775b366a36e" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:58554 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:48.293Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "36f945be-ed34-4258-99ea-8fd1afeebe38" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:58560 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:51.604Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "708a2065-e43d-4f13-b1eb-6a09081bb08a" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50960 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:55:54.602Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e77e18ef-9b4c-4b77-9019-ad6a8652061f" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50964 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:55:55.458086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:55:55.443Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c9eea40b-aa44-4ac5-8d1c-4c89b8910277" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:48904 10.132.0.31:443 10.132.0.10:50980 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:55:55.818Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "482fcbd4-848e-45f4-b9f8-2d17d2de85fd" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50984 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:56:01.668743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:56:01.756616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:56:01.742Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "676b7d62-7352-4c46-86ea-e0d2e3000ad1" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38222 10.132.0.31:443 10.132.0.10:37996 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:56:01.818Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "0baf7193-6357-48ce-825c-5b6ed9052a12" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46634 10.132.0.31:443 10.132.0.10:38004 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:56:03.152614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:56:03.138Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "4225b900-8697-4b35-8a6e-23e296e77987" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:38222 10.132.0.31:443 10.132.0.10:38014 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:56:03.513Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "262bd0bf-0726-4070-ae32-0ceb700ca335" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:38018 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-12T00:56:05.471892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:57:07.479224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:57:07.462Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "ec15dbea-50b8-49df-9ee6-b3fa5e758255" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:49670 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:57:07.499Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 21 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "aaede903-88d7-4422-9f13-a1e5ae9db8f2" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:49678 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-12T00:57:28.766896Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-12T00:57:30.991Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 292 32 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "8c61f67d-873f-4de4-b307-9c099127faa2" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:39136 10.132.0.31:443 10.132.0.10:37548 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-12T00:57:31.630914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:57:31.616Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "20255eb6-cac6-49bd-ad0e-4824286507f6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:37560 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:57:35.456204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:57:36.115995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:57:36.269923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:57:36.101Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "bbdac401-8879-4e7c-a494-accb80fc7f69" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:37574 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:57:36.259Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "fe74d643-11d7-45f2-8a5a-af04634234e6" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:37590 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:57:39.364661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:57:46.964918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:57:52.370964Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-12T00:57:52.424504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:13.122197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:58:13.156791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:58:13.105Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "4792dc4d-1aad-4386-9cf6-204a69c20101" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:46156 10.132.0.31:443 10.132.0.10:49652 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:13.145Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "ac560070-aeb2-4f9c-af9e-face2b5c4b3b" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:49656 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:58:16.810071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:21.473511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:22.516740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-12T00:58:22.549875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:58:22.501Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d3372e30-112e-4def-9169-a7ccff4aba86" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:46156 10.132.0.31:443 10.132.0.10:53128 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:22.540Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "6e06a65b-e4ec-4005-8573-45cb9e13cbde" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:46156 10.132.0.31:443 10.132.0.10:53142 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:58:25.659046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:32.478312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:58:32.510226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-12T00:58:32.656121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:58:32.463Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "5b72b7b6-d2e0-4727-8d68-9052c4c86c36" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:50542 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:32.500Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "cb3ce5bd-b366-4493-8b4b-47a427518b6b" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:50548 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:32.529Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "bdfb9720-4f95-4a15-945f-e19a42c01fbd" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:59338 10.132.0.31:443 10.132.0.10:50550 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:58:32.570Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "4b727512-e502-4a76-8788-51a564c9eec3" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50552 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:58:32.612Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "79ec9ddf-24bb-9c44-989f-da75722a8d94" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:50566 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-12T00:58:32.646Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "056e42bc-96cb-49fc-8a7b-9fe1d18c9960" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:46156 10.132.0.31:443 10.132.0.10:50568 - odh-ai-gateway-infra.maas-api-route.3 2026-09-12T00:58:34.758252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-12T00:58:40.302Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 16 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b6671b67-06e8-4ba9-8e6c-c13d08c3d66d" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:58974 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-12T00:58:42.770610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:46.425089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-12T00:58:46.400Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 24 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f4674924-815c-48a0-8be3-101e709623b1" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53488 10.132.0.31:443 10.132.0.10:58980 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:46.442Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b51c02ff-08c2-4a72-8d72-5719503b9bb0" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:57682 10.132.0.31:443 10.132.0.10:58996 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-12T00:58:46.598Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "16c499f6-b674-4e31-9003-00b713c53689" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:57682 10.132.0.31:443 10.132.0.10:59006 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-12T00:58:46.734Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "073ba311-f412-4358-9726-f560d9671454" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:57684 10.132.0.31:443 10.132.0.10:59014 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-12T00:58:46.874Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "749e798e-a35a-426f-a84f-c50869b6ad29" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.132.0.10:59024 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-12T00:58:49.578582Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:55.485303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-12T00:58:59.628139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-12T00:58:59.607Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 20 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "650617b0-f29a-4344-934c-69a31409fbd5" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.132.0.77:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:60050 10.132.0.31:443 10.132.0.10:56906 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-12T00:58:59.647Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 32 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "032f5cc4-05e3-4d53-bb78-a58b347255bf" "maas.apps.a98b6b23-23f0-45b6-9da6-40807bbef031.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:57682 10.132.0.31:443 10.132.0.10:56914 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-12T00:59:02.166144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9