2026-09-16T14:23:49.825470Z	info	FLAG: --concurrency="0"
2026-09-16T14:23:49.825488Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-16T14:23:49.825493Z	info	FLAG: --help="false"
2026-09-16T14:23:49.825496Z	info	FLAG: --log_as_json="false"
2026-09-16T14:23:49.825499Z	info	FLAG: --log_caller=""
2026-09-16T14:23:49.825502Z	info	FLAG: --log_output_level="default:info"
2026-09-16T14:23:49.825506Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-16T14:23:49.825513Z	info	FLAG: --log_target="[stdout]"
2026-09-16T14:23:49.825517Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-16T14:23:49.825520Z	info	FLAG: --outlierLogPath=""
2026-09-16T14:23:49.825523Z	info	FLAG: --profiling="true"
2026-09-16T14:23:49.825526Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-16T14:23:49.825529Z	info	FLAG: --proxyLogLevel="warning"
2026-09-16T14:23:49.825532Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-16T14:23:49.825535Z	info	FLAG: --stsPort="0"
2026-09-16T14:23:49.825538Z	info	FLAG: --templateFile=""
2026-09-16T14:23:49.825540Z	info	FLAG: --tokenManagerPlugin=""
2026-09-16T14:23:49.825544Z	info	FLAG: --vklog="0"
2026-09-16T14:23:49.825548Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-16T14:23:49.825713Z	info	Proxy role	ips=[10.134.0.36] type=router id=maas-default-gateway-openshift-default-78bb78ff78-cj4jw.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-16T14:23:49.825778Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-16T14:23:49.826814Z	info	cpu limit detected as 2, setting concurrency
2026-09-16T14:23:49.827041Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-16T14:23:49.827053Z	info	JWT policy is third-party-jwt
2026-09-16T14:23:49.827057Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-16T14:23:49.829003Z	info	Starting default Istio SDS Server
2026-09-16T14:23:49.829030Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-16T14:23:49.829053Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-16T14:23:49.829328Z	info	Opening status port 15020
2026-09-16T14:23:49.830494Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-16T14:23:49.830790Z	info	sds	Starting SDS grpc server
2026-09-16T14:23:49.832533Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-16T14:23:49.832210Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-16T14:23:49.833870Z	info	Starting proxy agent
2026-09-16T14:23:49.833900Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-16T14:23:49.897679Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=9
2026-09-16T14:23:49.897975Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=9
2026-09-16T14:23:49.903717Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-16T14:23:49.999712Z	info	ads	ADS: new connection for node:1
2026-09-16T14:23:50.000167Z	info	ads	ADS: new connection for node:2
2026-09-16T14:23:50.483081Z	info	cache	generated new workload certificate	resourceName=default latency=651.97942ms ttl=23h59m59.516925256s
2026-09-16T14:23:50.483115Z	info	cache	Root cert has changed, start rotating root cert
2026-09-16T14:23:50.483157Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.516844178s
2026-09-16T14:23:50.483177Z	info	cache	returned workload certificate from cache	ttl=23h59m59.516823636s
2026-09-16T14:23:50.483264Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.516738868s
2026-09-16T14:23:50.483654Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.51634819s
2026-09-16T14:23:50.526086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:23:56.783560Z	info	Readiness succeeded in 6.960457849s
2026-09-16T14:23:56.783888Z	info	Envoy proxy is ready
2026-09-16T14:24:02.570315Z	info	ads	ADS: new connection for node:3
2026-09-16T14:24:02.570455Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-16T14:24:02.570480Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-16T14:24:02.853399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:24:40.029876Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:24:55.832907Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:25:14.468736Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:25:23.575405Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:25:30.650018Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:25:40.766142Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:27:03.485952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:27:03.456Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 29 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "4f0df9d9-65ec-4779-b3eb-926fa46fda2e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:57128 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:27:03.571127Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:04.166015Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:04.414479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:27:03.535Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 36 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "c7d27986-e39f-4586-aff4-40374f50eac0" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:57132 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:03.626Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 386 57 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "08df9559-4293-449e-8b2d-29f025401431" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:57142 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.725Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 390 20 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "e69f190b-9d69-4020-90d6-89c21312e6b3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:57146 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.774Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 411 16 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "51810f0c-520b-4f6b-82e9-d15809acee69" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:57160 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.818Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 528 15 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "47e6cbe6-1ebd-4f99-8100-6d7c35223af3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:57168 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.858Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "09e9bfc2-f73a-460d-b9d0-b657302204c4" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57170 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.895Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "cc0fcac6-de09-4b05-9d66-d959a0c95b74" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57174 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.935Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "dcee5cd4-d2a4-4c7e-ad30-352ec8e8a38a" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57184 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:03.973Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "71e9ba9e-a898-47f7-ba93-95c2dd2b8dca" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57198 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:04.008Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "f35852d4-f0de-4005-88a3-f61fe26b9dd6" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57214 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:04.044Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "c32619ab-eafd-4391-b82e-38776ab63313" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57220 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:04.085Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "780ed461-353e-41ff-95f9-d34bd1511f97" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57234 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:04.122Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 0 4 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "01075625-d7a4-4ec7-814a-f1260ce243f7" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57238 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-16T14:27:04.152Z] "DELETE /v1/api-keys/de9d0a85-a4f7-4d38-899e-c6ef517b5ccc HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "0f5dc480-03c5-463e-ad0b-9856105f202b" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:57244 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:04.410Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "f772a0b0-d627-4e45-965f-ef984d6ffabb" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:57248 - odh-ai-gateway-infra.maas-api-route.4
2026-09-16T14:27:04.450345Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:27:04.438Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "d84e6172-fa5b-4c58-a241-7d6d0531bfa1" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:57254 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:27:18.256831Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:18.312761Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-16T14:27:18.322613Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:27:18.241Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "aec231c1-f2e3-4223-b405-9b5d3b206897" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38884 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.278Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6ecba995-8e5b-481c-8ebf-c167381512de" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.36:443 10.133.0.9:38898 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.309Z] "DELETE /v1/api-keys/9b68c71d-ad11-416b-850c-4f32fd60c7ea HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cd25a362-408b-46a6-aa87-e99514f6fc4f" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38902 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:27:18.499404Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:18.534490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:18.597317Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:18.632404Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:18.708482Z	info	ads	ADS: new connection for node:4
2026-09-16T14:27:18.711397Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-16T14:27:18.711440Z	info	cache	read certificate from file	resource=file-root:system
2026-09-16T14:27:18.814592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:18.851017Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:18.905481Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-09-16T14:27:18.917117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:18.949324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:19.110731Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:19.303976Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:19.419163Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:27:18.486Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "db1692b8-4afb-4560-9d3a-c54264437794" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38916 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.521Z] "DELETE /v1/api-keys/0be90314-8821-4eb6-a98d-939195c8a9e1 HTTP/1.1" 200 - via_upstream - "-" 0 321 12 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3b000ad4-c136-45e2-adb3-75e48d8aea55" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38930 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.557Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0815d15e-b93b-49e0-a4fd-ef7e13643b63" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.36:443 10.133.0.9:38938 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.584Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 12 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7520f70f-f049-4952-8c15-f30412285d52" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:38954 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.618Z] "DELETE /v1/api-keys/a56fa1cc-bc23-4b10-a91d-bb684524faa3 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d6605b53-548f-4824-bd7e-81c5fa4c6562" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38962 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.801Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0da04286-8c44-42dc-a5dd-c5387542bee0" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:38976 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.836Z] "DELETE /v1/api-keys/b7136550-eb34-48e6-bda9-0cfda9c67d69 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7a0da535-625a-4104-b348-71713e644ae0" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:38982 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.871Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "78b3c592-45ec-41d6-ad06-ca8a0422aca5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.36:443 10.133.0.9:38996 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.901Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "af7bd454-d6a7-4380-a862-7534643340e3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:39002 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:18.935Z] "DELETE /v1/api-keys/7714f633-e757-4f71-b9c5-a71f504b15b7 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e301ed0f-9a28-4ceb-a03e-d437ea654a7f" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:39006 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:19.096Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "53cff86a-7faa-401c-b55b-74107e2588f5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:39020 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:19.131Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 13 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f6a1413a-a994-44cd-b99c-506455f4e2bb" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:39036 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:19.289Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "234d32e2-d149-4ebf-9b2c-91e892360ee5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:39038 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:19.322Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 23 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6f00d112-857e-48ce-8e81-053c2a09eb6c" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:39046 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:19.363Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 20 - "52.71.36.72,10.133.0.9" "-" "df4265d4-ab8e-4863-a8c9-672aceff8b63" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:39050 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:19.406Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 12 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b5ec7e76-fe0f-4d6a-bc8d-a7f6f75f8602" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:39054 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:27:23.275205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-16T14:27:24.447Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d935a4c4-9f72-40fe-b266-24920bd6dee3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:39058 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:27:25.754313Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:27:25.740Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5783191b-52a9-4136-a268-0bf006c4f41a" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:39070 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:26.054Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7c17a3d1-3dbd-4b7f-b38f-795b4e02babe" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" - - 10.134.0.36:443 10.133.0.9:39086 - -
[2026-09-16T14:27:26.132Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cd911e2c-333c-4406-b8d4-f29e5ceb35e2" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.36:443 10.133.0.9:39090 - llm.e2e-external-model.0
[2026-09-16T14:27:26.171Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 6 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1eb6e07e-d759-4056-869c-d831b418ef47" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.36:443 10.133.0.9:39106 - llm.e2e-external-model.0
2026-09-16T14:27:28.847357Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:27:28.832Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e5399f38-d9b8-4e98-9fd2-be30f63b1ce2" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:56700 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:28.866Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bebc9f21-aa7d-4561-8d78-a2fee471bb61" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:56710 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:27:30.770401Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:30.900115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:30.900385Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-16T14:27:30.751Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4116caca-a5fe-4166-b8ec-a5a60088448c" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:56722 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:27:30.793Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 22 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "9aff9090-a453-4956-87ac-3b93ce367106" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:56736 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:30.834Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 23 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4bf04426-93e6-4061-adaa-b222790dc70f" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:56748 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:26.197Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 4702 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f078c318-43ec-42f3-9317-8ad38f361bd3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.36:43582 10.134.0.36:443 10.133.0.9:39120 - llm.e2e-external-model.1
[2026-09-16T14:27:30.880Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 29 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8299ffb6-b6cc-470a-9a4d-bdc473fba064" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:56762 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:27:30.933Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 23 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a2ac23b1-1de0-40fa-9b09-29b5da213c35" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:56778 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:27:31.430931Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:31.580398Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:27:31.103Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cf6c66b7-aee9-4ad1-9d91-bccc50908dd4" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" - - 10.134.0.36:443 10.133.0.9:56788 - -
[2026-09-16T14:27:31.247Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 8 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8f593d50-aeea-44e6-8122-5e309ffce63c" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" - - 10.134.0.36:443 10.133.0.9:56792 - -
[2026-09-16T14:27:31.399Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3c9a1794-99fa-46fb-b4f4-51873f43cdc4" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" - - 10.134.0.36:443 10.133.0.9:56804 - -
[2026-09-16T14:27:31.427Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ed745e2b-165f-4093-8b29-e5b4de22e39d" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47936 10.134.0.36:443 10.133.0.9:56816 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-16T14:27:31.567Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 872 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "87c401bd-6ce1-4ce6-a6db-7cbaba618b59" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:47924 10.134.0.36:443 10.133.0.9:56824 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:27:37.317904Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-16T14:27:43.541Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 7 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5ea13526-1027-462a-bad1-f4b1d86efb92" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" - - 10.134.0.36:443 10.133.0.9:46944 - -
2026-09-16T14:27:49.781050Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:27:49.781304Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-16T14:27:47.304Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 2476 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ac67d656-738e-4938-b580-b7062a9667fd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.36:53000 10.134.0.36:443 10.133.0.9:46946 - llm.e2e-external-model.1
2026-09-16T14:27:50.527875Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:27:51.401973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:51.402153Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-16T14:27:49.809Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 1592 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "fce236f9-e73a-4902-abdc-21e853f9edd5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.36:53014 10.134.0.36:443 10.133.0.9:55188 - llm.e2e-external-model.2
2026-09-16T14:27:53.930620Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:27:53.930781Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-16T14:27:51.426Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 2504 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a5dad7bc-de38-4bb2-8d09-71e2577581ee" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.36:53014 10.134.0.36:443 10.133.0.9:55196 - llm.e2e-external-model.2
2026-09-16T14:27:55.041909Z	info	ads	ADS: "" 4 terminated with stream closed
2026-09-16T14:28:04.601558Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:31:30.223572Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:31:42.378619Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:39:01.402544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:39:27.138434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:46:13.094643Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:46:13.074Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 310 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "fb60df37-6918-4c69-8d6c-ebb348776d88" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:48990 10.134.0.36:443 10.133.0.9:44354 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:46:13.120Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 319 31 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8a3c60a7-9b9a-4f74-8dae-267e5cb71e00" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:44364 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-16T14:46:13.175Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 327 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "666cd8cc-68a8-4122-be36-3356743db3fe" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:44368 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-16T14:49:49.023497Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:49:49.006Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "15f16dc4-dc8c-4c74-89e4-4feeacff25e5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:34000 10.134.0.36:443 10.133.0.9:56360 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:49:51.256810Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:49:51.241Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "db5bbfbd-4e97-463a-bda4-ff62de5f9c45" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:50838 10.134.0.36:443 10.133.0.9:56374 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:49:51.998381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:51:13.074092Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:51:13.601414Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:51:13.587Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "edbd0352-28a9-4697-8e2c-891c6b65a48b" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:53004 10.134.0.36:443 10.133.0.9:50126 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:51:41.771184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:51:45.269120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:51:45.243Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 25 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ce0c218a-3ad8-4dee-89c7-4b34c162e32e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:37612 10.134.0.36:443 10.133.0.9:53688 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:51:45.297Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 41 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d6958798-4ead-4476-b381-4324f9e90378" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58866 10.134.0.36:443 10.133.0.9:53704 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:45.462Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "21ebe4ae-a512-479d-9d23-446659a6dc56" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58872 10.134.0.36:443 10.133.0.9:53718 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:45.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3589d3a2-28b1-4326-a54c-b609605beb2e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58872 10.134.0.36:443 10.133.0.9:53728 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:45.746Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4d7777ec-92f0-4de0-80c9-79e717e1cab0" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58866 10.134.0.36:443 10.133.0.9:53742 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:45.883Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6adb0063-1825-41b3-926a-a3de90c5f173" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58872 10.134.0.36:443 10.133.0.9:53756 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:46.026Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d66cc145-f1f2-4066-9900-74cba594614b" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:53760 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:51:49.662671Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:51:54.712199Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:51:54.858819Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:51:54.697Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1200f89f-065d-45ec-9ed1-7ca06cd7576e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:53004 10.134.0.36:443 10.133.0.9:52654 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:51:54.736Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e6c6e748-32b6-4576-8f3f-7ca9c7413cc7" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58866 10.134.0.36:443 10.133.0.9:52662 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:54.772Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "20d0f530-cebb-449d-b137-64146eb08fb5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:52668 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:54.807Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "c14b461b-40d1-4bfd-ad98-86dd969afbfd" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:52682 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:54.844Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "9a32faa4-ab14-45e6-b259-69623e2da268" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:58872 10.134.0.36:443 10.133.0.9:52696 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
2026-09-16T14:51:55.628252Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:51:55.613Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d6139957-8acf-423c-b176-7ebc1154bea4" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:53004 10.134.0.36:443 10.133.0.9:52708 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:51:55.653Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "40fef5b5-0724-434f-b02e-f2c29f8030c7" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:52712 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:56.666Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cddd4a1e-d50c-49f6-b8fe-9bb92006af88" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51372 10.134.0.36:443 10.133.0.9:52726 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:51:57.408Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bce5c4d1-b85c-4d69-a281-49ea6a7f062e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:52728 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:51:58.679875Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-16T14:51:58.477Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f30dfc5a-da66-9dd6-8e63-6290def47972" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:53868 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:52:03.901Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "eb2ecd37-388c-401f-99bb-75e66ae56bf3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:53880 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-16T14:52:08.965Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6e96915b-9aef-4372-8efd-eb7ae120ce3b" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:36772 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:52:09.803019Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:52:09.788Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "2bc81d56-84d0-472d-aa0d-5a6605850802" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:37612 10.134.0.36:443 10.133.0.9:36778 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:52:10.164Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a26f6211-fb9d-44cf-88bd-9f0d7bbd08e3" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:36788 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:52:16.065774Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:52:18.139394Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:52:18.125Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "13045fda-64fd-4350-8b9d-1546bed28899" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:37612 10.134.0.36:443 10.133.0.9:37572 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:52:18.159Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "29a70bab-bbe5-4148-be03-d43d316fb2c2" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51378 10.134.0.36:443 10.133.0.9:37580 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:52:19.473750Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:52:19.459Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7c57a809-515c-45cf-a641-592df498434d" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:53004 10.134.0.36:443 10.133.0.9:37584 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:52:19.815Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1e18007f-ed57-4006-be0f-72f1658b9866" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:37590 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-16T14:52:22.984525Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:53:25.787442Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:53:25.770Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "92eadc8e-4ad1-4325-94eb-f578cae5f260" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43678 10.134.0.36:443 10.133.0.9:59344 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:53:25.809Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 49 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ccfefab7-e908-4e9a-9bd6-1d2dacc2daa0" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:59348 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-16T14:53:46.077964Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:53:48.531139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:53:47.859Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 32 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "17e74aa5-f2f5-41c0-a31c-7960fc21190a" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.42:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:45910 10.134.0.36:443 10.133.0.9:49978 - llm.e2e-trlp-test-simulated-kserve-route.0
[2026-09-16T14:53:48.514Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "56a5197a-ab28-4c84-9eee-320b7591532e" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:38696 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:53:52.875772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:53:52.904476Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:53:53.059620Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:53:52.889Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "373b749f-11a2-4dc5-b6eb-bdf7e05b8314" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:38704 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:53:53.049Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "c5ef9b36-8736-47f1-8ad0-76e8e2d7085b" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:38716 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:53:55.294571Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-09-16T14:53:56.970969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:54:10.383784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:54:21.790369Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:54:51.225333Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-16T14:54:51.263347Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:54:51.205Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b455df82-41f8-4016-811c-1e105729cf1a" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:56122 10.134.0.36:443 10.133.0.9:38712 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:54:51.251Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "273b5af4-b3cc-481a-8af4-14af76f3c484" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:38726 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:54:55.276187Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:54:59.790312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:55:00.444345Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-16T14:55:00.477525Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:55:00.430Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6a9d55d8-1543-4468-af3f-63cc64a75387" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:57596 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:55:00.467Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 9 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "99f84890-bed9-46b0-ae84-595b93bad305" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:43192 10.134.0.36:443 10.133.0.9:57598 - odh-ai-gateway-infra.maas-api-route.3
2026-09-16T14:55:02.969964Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-16T14:55:07.558Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 39 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3c4e9ee0-3d85-4594-9635-25067dfef04c" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:57614 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-16T14:55:10.885492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:55:15.858544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-16T14:55:15.836Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 316 21 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8c19dd22-64e9-4efe-bfe8-a48714dfda04" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.80:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:34400 10.134.0.36:443 10.133.0.9:55980 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:55:15.879Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 43 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "99e501cb-f199-4f91-a8ca-c36386874a87" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51692 10.134.0.36:443 10.133.0.9:55984 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-16T14:55:16.046Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6d704cb3-5828-432d-bb71-4ea7c50d8aac" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51692 10.134.0.36:443 10.133.0.9:55990 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-16T14:55:16.189Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "055951d8-9c24-47b9-a0e0-c0bd2f0fa879" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51692 10.134.0.36:443 10.133.0.9:55996 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-16T14:55:16.330Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "2126b03b-ceff-4a8a-baf3-b3cf02e35bc5" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.36:443 10.133.0.9:56006 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-16T14:55:18.679053Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:55:24.485928Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-16T14:55:29.036984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-16T14:55:29.019Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "c254cf3c-7a76-4f18-8865-925dfd472397" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.134.0.80:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.36:58300 10.134.0.36:443 10.133.0.9:35322 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-16T14:55:29.063Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "011f6c14-17ce-4d78-a151-9448e30c7c27" "maas.apps.5402c0de-9648-40cc-8779-24a87c34e583.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:51692 10.134.0.36:443 10.133.0.9:35334 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-16T14:55:31.465068Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9