2026-09-15T07:31:56.663134Z	info	FLAG: --concurrency="0"
2026-09-15T07:31:56.663154Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-15T07:31:56.663158Z	info	FLAG: --help="false"
2026-09-15T07:31:56.663160Z	info	FLAG: --log_as_json="false"
2026-09-15T07:31:56.663162Z	info	FLAG: --log_caller=""
2026-09-15T07:31:56.663164Z	info	FLAG: --log_output_level="default:info"
2026-09-15T07:31:56.663166Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-15T07:31:56.663172Z	info	FLAG: --log_target="[stdout]"
2026-09-15T07:31:56.663174Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-15T07:31:56.663176Z	info	FLAG: --outlierLogPath=""
2026-09-15T07:31:56.663178Z	info	FLAG: --profiling="true"
2026-09-15T07:31:56.663180Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-15T07:31:56.663182Z	info	FLAG: --proxyLogLevel="warning"
2026-09-15T07:31:56.663185Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-15T07:31:56.663187Z	info	FLAG: --stsPort="0"
2026-09-15T07:31:56.663189Z	info	FLAG: --templateFile=""
2026-09-15T07:31:56.663194Z	info	FLAG: --tokenManagerPlugin=""
2026-09-15T07:31:56.663196Z	info	FLAG: --vklog="0"
2026-09-15T07:31:56.663199Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-15T07:31:56.663335Z	info	Proxy role	ips=[10.133.0.36] type=router id=maas-default-gateway-openshift-default-5ccb968c66-nj4wg.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-15T07:31:56.663391Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-15T07:31:56.664528Z	info	cpu limit detected as 2, setting concurrency
2026-09-15T07:31:56.664740Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-15T07:31:56.664750Z	info	JWT policy is third-party-jwt
2026-09-15T07:31:56.664754Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-15T07:31:56.666104Z	info	Starting default Istio SDS Server
2026-09-15T07:31:56.666157Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-15T07:31:56.666175Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-15T07:31:56.666559Z	info	Opening status port 15020
2026-09-15T07:31:56.668150Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-15T07:31:56.669432Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-15T07:31:56.670293Z	info	Starting proxy agent
2026-09-15T07:31:56.670323Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-15T07:31:56.678744Z	info	sds	Starting SDS grpc server
2026-09-15T07:31:56.678774Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-15T07:31:56.725840Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=9
2026-09-15T07:31:56.726160Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=9
2026-09-15T07:31:56.731828Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-15T07:31:56.800152Z	info	cache	generated new workload certificate	resourceName=default latency=131.784921ms ttl=23h59m59.199852263s
2026-09-15T07:31:56.800195Z	info	cache	Root cert has changed, start rotating root cert
2026-09-15T07:31:56.800231Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.199769893s
2026-09-15T07:31:56.818894Z	info	ads	ADS: new connection for node:1
2026-09-15T07:31:56.818969Z	info	cache	returned workload certificate from cache	ttl=23h59m59.181032845s
2026-09-15T07:31:56.819324Z	info	ads	ADS: new connection for node:2
2026-09-15T07:31:56.819404Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.180597538s
2026-09-15T07:31:56.862812Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:32:02.565486Z	info	Readiness succeeded in 5.904566185s
2026-09-15T07:32:02.565768Z	info	Envoy proxy is ready
2026-09-15T07:32:11.963688Z	info	ads	ADS: new connection for node:3
2026-09-15T07:32:11.963853Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T07:32:11.963883Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T07:32:12.207513Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:32:19.816532Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:32:43.130981Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:33:02.627318Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:33:15.148375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:33:28.738141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:33:52.958508Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:35:02.565381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:35:02.536Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 28 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "66124520-1d37-4a0a-a790-02cc0601b52d" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:56038 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:35:02.666800Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:35:02.629Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "28c639f2-bc2a-4640-89d9-741deea32ccb" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:56054 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:35:03.272895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-09-15T07:35:03.362357Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:03.606302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:03.647992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:35:02.728Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 337 58 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "97e4213f-9b6d-4591-86bf-e99c8eca5206" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:56060 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:02.828Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 346 19 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "b6f57cbd-47c2-40d3-a1c3-121d4aa01502" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:56074 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:02.879Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 369 15 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "b5491cad-fa38-4f92-8bd9-9bf99d1e903f" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:56078 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:02.941Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 423 16 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "ac134e9b-159c-4275-9643-fbe5e31b04ca" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:56082 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:02.990Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 507 15 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "30f44e42-a2f9-42ab-82a1-1f9444887f88" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:56090 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.053Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "c7ecf041-9bbf-4e27-b12c-06261c76c9ef" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56106 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.095Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "0f2423e1-1e49-4346-a19f-52f53918c5b6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56108 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.135Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 11 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "3d54554b-79f0-4e2e-b1b2-14c70a4c184e" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56112 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.188Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 12 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "318cc685-ea3b-4806-a48d-19dd2c31233b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56126 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.225Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 11 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "dff0e35f-6faa-4cd8-8dee-b8ab086a45cc" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56142 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.262Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 11 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "591af329-3fe0-45db-9520-15d72706af51" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56158 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.317Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 0 4 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "1ed29673-f2a2-4895-9950-9d52048cb3ea" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:56174 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T07:35:03.348Z] "DELETE /v1/api-keys/88b2093d-7106-4b81-b0a4-80360f704ff2 HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "7a149d53-7451-4b20-b770-13b006d390ca" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:56180 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:03.602Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "ffeb3794-0cd3-4f9b-8abd-d649d00fd09f" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:56186 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T07:35:03.636Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "44.212.242.249,10.134.0.9" "curl/7.76.1" "8d71b7cf-8dfc-9259-9ead-d9ebf7222743" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:56196 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:35:13.616378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:35:13.612Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "8c35a9c1-a071-4333-94ce-c5254be13810" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:36920 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T07:35:13.642Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 -  - "-" 20 0 5 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "1b5f7eef-e67e-475a-8819-bbd64e32d513" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.36:443 10.134.0.9:36924 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:35:13.684002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:13.728254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:13.772549Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:13.772718Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-15T07:35:13.776231Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:13.826568Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:13.826729Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T07:35:13.837763Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-15T07:35:13.840809Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:13.998692Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.031289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.114202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.149180Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.186463Z	info	ads	ADS: new connection for node:4
2026-09-15T07:35:14.191201Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-15T07:35:14.191280Z	info	cache	read certificate from file	resource=file-root:system
2026-09-15T07:35:14.310022Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:14.345201Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:14.408151Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.440070Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T07:35:14.587412Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:35:13.671Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d61e28c9-5456-4e4b-a063-6a56bb5ce392" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:36932 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:13.715Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "ae9d9442-8971-4012-9137-528071d9d81d" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:36934 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:13.749Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 23 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "eaccb406-cb8c-4edd-9b3f-d5fae65721d8" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:36944 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T07:35:13.762Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "434e1d1b-fdf8-42a4-8f7b-078130ee8acf" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:36950 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:13.799Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 8 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9b138a47-07ea-450d-915e-b466ae40ba76" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.36:443 10.134.0.9:36956 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:13.795Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 31 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "22a4aa68-92f6-4db3-a87e-535f90812e9f" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:36954 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:35:13.827Z] "DELETE /v1/api-keys/c13d3e1e-3604-40a9-b74c-0e0505c41d8f HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "11f46bb5-162b-4d62-97e1-f03036521b92" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:36966 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:13.985Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "e4711092-3987-4462-9346-8d65b44470ad" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:36974 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.018Z] "DELETE /v1/api-keys/e65c392d-51a3-4f51-a9c4-f5a257f2b1d5 HTTP/1.1" 200 - via_upstream - "-" 0 321 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c300f757-a79e-4a0a-9662-d84a89c6bdcc" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:36986 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.048Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "98568fd5-e7aa-4a4e-a098-b17bdeb49a54" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.36:443 10.134.0.9:36992 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.101Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "0f6f0942-c9f8-47a8-a03f-51056f7f7a50" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:37000 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.136Z] "DELETE /v1/api-keys/07ff897b-c68a-4683-967c-ec918935b3cd HTTP/1.1" 200 - via_upstream - "-" 0 321 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "3e72c4a4-b03f-46a1-bed7-d3c7b6c58b9b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:37012 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.295Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "861deecd-3d2c-48eb-805c-662f79960145" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:37020 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.328Z] "DELETE /v1/api-keys/2a51e7b1-7a2c-47e5-a8a2-e63185eff822 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dbe02c61-cc27-4e60-bdb4-03cfdb069713" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:37026 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.363Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "edc19e9d-f919-4a85-a86e-6eccf43eae78" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.36:443 10.134.0.9:37040 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.392Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "7d2c1a99-8852-482d-95bf-cfb46382728c" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:37046 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.426Z] "DELETE /v1/api-keys/35c0c0b8-f3c7-4767-92aa-15087ce3152d HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "65ae5a85-e54a-4ba3-b39e-5617a604f4ff" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:37062 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.574Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d535cd98-c756-46b3-abc0-4bd82c25e167" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:37076 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.607Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 13 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "1bb0fc78-5d85-44c7-aa10-6abf31eb83d3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:37084 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T07:35:14.773898Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:14.885765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:35:14.760Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "2bd2f846-37b4-4362-a07e-5f0b3f0aff49" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:37092 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:14.794Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "58d312d3-27f1-416d-8005-60348c95747d" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:37100 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:35:14.829Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 16 - "44.212.242.249,10.134.0.9" "-" "0bb05e55-15b9-415a-8093-228a672c4a7b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:37108 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:35:14.865Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f41b402a-93fc-4441-9f1a-31091f6c7936" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:37112 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:35:19.070440Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-15T07:35:19.911Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 11 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "514babf9-75cb-479a-949c-52f39f3ec64c" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:36022 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T07:35:21.229554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:35:21.214Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "90ec7465-e2ed-48df-b3f3-f987464cbc53" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:36028 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:21.340Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 6 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "1880987f-45d9-4431-9e9d-6c0c375a40c3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" - - 10.133.0.36:443 10.134.0.9:36036 - -
[2026-09-15T07:35:21.632Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 9 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "98a21057-a81e-4d29-8aee-845c0111daeb" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.133.0.36:443 10.134.0.9:36052 - llm.e2e-external-model.0
[2026-09-15T07:35:21.665Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 5 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d1b1ed40-3af6-4d4e-a76d-d2cece9ff7f9" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.133.0.36:443 10.134.0.9:36058 - llm.e2e-external-model.0
2026-09-15T07:35:22.656324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:22.656519Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-15T07:35:21.691Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 965 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "64b224dd-ff75-4b5b-81c9-b2b77d578539" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.36:46020 10.133.0.36:443 10.134.0.9:36062 - llm.e2e-external-model.1
2026-09-15T07:35:27.089391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-15T07:35:35.346Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 8 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "27883183-544d-4441-8be0-c7211d84ab20" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" - - 10.133.0.36:443 10.134.0.9:43188 - -
2026-09-15T07:35:39.689646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:39.689974Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-15T07:35:39.928942Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:39.929171Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-15T07:35:39.000Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 689 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dadc1d9c-0d0d-4499-9f9a-bb59354c6696" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.36:34548 10.133.0.36:443 10.134.0.9:36262 - llm.e2e-external-model.1
[2026-09-15T07:35:39.714Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 214 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "10eed0b2-ad64-4a6d-a87a-3e74383957c2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.36:34548 10.133.0.36:443 10.134.0.9:36274 - llm.e2e-external-model.2
2026-09-15T07:35:40.577972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:35:40.578248Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-15T07:35:39.956Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 621 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "0d8d1c50-abcb-4ca4-8bcc-66714c7fb3df" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.36:34548 10.133.0.36:443 10.134.0.9:36284 - llm.e2e-external-model.2
2026-09-15T07:35:41.629674Z	info	ads	ADS: "" 4 terminated with stream closed
2026-09-15T07:35:42.034157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:35:54.366164Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:35:55.999671Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:35:55.985Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9a8faffc-19a0-4bb0-9d65-877d637ef9c6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:54070 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:35:56.028Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "21aa8be5-565e-47f0-9473-a1022c2847fe" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:54072 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T07:35:59.974992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:35:59.960Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "bdc10163-7215-4062-835b-6fca0c5156a3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35042 10.133.0.36:443 10.134.0.9:55514 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:36:00.000Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 19 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dc918fd8-3c54-4065-b8c8-ab4b464f6c1e" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:55516 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:36:00.054Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 25 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f49f5aa8-f8dd-476a-bdc1-9210a3e8470f" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:55532 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:36:00.104Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "cc8c577d-3d29-4ade-9e75-661ea75c66d4" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:55538 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:36:00.146Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "05f92f5a-9a1c-41e4-ac53-428b5219b5d7" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:55540 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T07:36:13.007Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "463eb9e0-642d-4684-a8d1-8817c86107a6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" - - 10.133.0.36:443 10.134.0.9:38544 - -
[2026-09-15T07:36:13.154Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9f629858-e117-422c-88bb-35c86ab7440c" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" - - 10.133.0.36:443 10.134.0.9:38560 - -
2026-09-15T07:36:13.336615Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T07:36:13.480536Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:36:13.300Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c26e3513-7978-4390-b4d4-fe11f0c03ac8" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" - - 10.133.0.36:443 10.134.0.9:38576 - -
[2026-09-15T07:36:13.331Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b003a344-f192-4b40-b5d5-652fad21e386" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:38582 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T07:36:13.466Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "141668ea-22ed-4d31-9428-fbed634b9da4" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:35052 10.133.0.36:443 10.134.0.9:38584 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:39:32.076895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:39:45.177906Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T07:55:08.776778Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:55:08.751Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 25 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "7e6f5af6-79c8-43b9-a9dc-7562fd2db085" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:45046 10.133.0.36:443 10.134.0.9:52054 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T07:55:08.807Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 36 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f8daae59-1cf8-407d-a5c9-0c7e0b15dd3a" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:52064 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T07:55:08.865Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "eb1cc06f-90f7-9db3-8421-af65d707ebce" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:52076 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-15T07:58:39.071252Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T07:58:39.054Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "154ccccd-dcf1-4378-90e9-cd7dd07fe25b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:42156 10.133.0.36:443 10.134.0.9:53926 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:58:40.840882Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T07:58:40.826Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "0bfa8bab-b2ca-4127-a236-bfa93c08ddcc" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:42160 10.133.0.36:443 10.134.0.9:53932 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T07:58:42.079802Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:00:03.860321Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:00:04.397371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:00:04.382Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d7dc6aa5-6b82-4002-8aac-980e2f2f563d" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33168 10.133.0.36:443 10.134.0.9:57296 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:00:27.477579Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:00:30.787090Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:00:30.763Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 23 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dc07ae68-524d-4005-a1fb-ed140f9235f2" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33168 10.133.0.36:443 10.134.0.9:38668 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:00:30.808Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 41 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "810b42e0-7e8a-436b-b652-69ad6b7bdb23" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:38678 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:30.971Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "cda9d215-9796-4b38-9af5-24c692fee81f" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51864 10.133.0.36:443 10.134.0.9:38694 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:31.106Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c3559add-bfb6-4284-ba67-780890ed7027" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:38702 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:31.248Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "fa155b1a-ae38-4b30-8ea4-2a7ca019f254" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:38716 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:31.409Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c12cedb5-3403-4f88-924a-d423cf8cfcd5" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:38720 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:31.550Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "bebfc57a-2a21-4c04-b37c-bb25e813d2f2" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:38734 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:00:35.177016Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:00:40.262762Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T08:00:40.464689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:00:40.247Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "2b5c746b-b37e-45ba-b2c7-a4bf030fefb3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37482 10.133.0.36:443 10.134.0.9:52850 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:00:40.303Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f17c6b21-5369-46f8-8d95-beb26e52905a" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51864 10.133.0.36:443 10.134.0.9:52866 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:40.347Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "398f00a8-b46b-4cc1-ae6b-afa2ac19af23" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:52868 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:40.385Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d2b67a0f-155a-4e47-8dd7-7cfe2f0afbaa" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:52870 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:40.423Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "49d2dc90-811d-462b-b875-5e5962deeb60" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:52876 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:40.451Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "8c4c8ce8-d7c0-4b5e-aa26-c23ce1be95f3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:52886 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
2026-09-15T08:00:41.179554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:00:41.165Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "68e3dc48-b963-4400-9bdc-bceda8c18b6a" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33168 10.133.0.36:443 10.134.0.9:52890 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:00:41.196Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "e36bb9b4-6ade-4330-a8c0-a82c684e12c6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:52894 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:42.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "07985471-1b86-4a5e-af75-0ea2848e2d36" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:52898 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:00:43.485026Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-15T08:00:42.898Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "0eaf6e52-0471-4e70-afca-e9a0f6b0a31d" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:52910 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:43.970Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "a42cae93-785a-4842-8fc7-18b008f3ebbc" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33812 10.133.0.36:443 10.134.0.9:52918 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:49.445Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "462debc6-5837-45ec-863f-defc2b553053" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:58348 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:00:54.557Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b2f745f1-091d-456f-a67f-5489cce23a9e" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:58364 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:00:55.391338Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:00:55.376Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d0031a18-091a-4121-858c-e688c6e52a30" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37482 10.133.0.36:443 10.134.0.9:58374 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:00:55.744Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "4c6fe87d-51ac-4c67-b3c1-84b41d81d089" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:58386 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:01:01.898873Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:01:03.773274Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:01:03.758Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "31723e79-c414-4ae5-816f-d062e32debf8" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33168 10.133.0.36:443 10.134.0.9:49064 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:01:03.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d762562d-1aa0-488b-ad08-7c6ddc559bf3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:33810 10.133.0.36:443 10.134.0.9:49074 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:01:05.191223Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:01:05.177Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dd6fee6b-0c27-461a-86fc-2473df93771e" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37482 10.133.0.36:443 10.134.0.9:49082 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:01:05.565Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c749becb-b640-4a7b-96fd-97006c0ab29b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:49090 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T08:01:07.759892Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:02:09.481734Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:02:09.466Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b36c2e26-3934-4c99-87ae-77d7abfc9906" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:39262 10.133.0.36:443 10.134.0.9:53140 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:02:09.505Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 49 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b2a0267b-4927-9da3-9d4b-64fcbebc59f8" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:53146 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-15T08:02:30.773960Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-15T08:02:32.906Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 294 31 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "5065f8de-5136-4357-b3f7-a8cf2e9140f6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:36586 10.133.0.36:443 10.134.0.9:35174 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-15T08:02:33.515919Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:02:33.501Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "1efa7580-9c1b-499e-ac06-0d6e9f69ee80" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:33784 10.133.0.36:443 10.134.0.9:35190 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:02:37.578645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:02:39.699253Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T08:02:39.840438Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:02:39.684Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f22948d2-3100-4871-992d-26bc68fd1d86" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:39262 10.133.0.36:443 10.134.0.9:44316 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:02:39.830Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 9 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "7d20c720-436b-493c-b7bc-9420d687f1a3" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:39262 10.133.0.36:443 10.134.0.9:44324 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:02:42.762435Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:02:50.104883Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:02:56.089322Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:03:43.650031Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T08:03:43.688267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:03:43.627Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 22 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "3142bc49-e0d2-4960-a994-808439a6e422" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37070 10.133.0.36:443 10.134.0.9:50182 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:03:43.668Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 19 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "4f70702f-cac1-4d84-873a-529c920d16a2" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37078 10.133.0.36:443 10.134.0.9:50190 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:03:48.440042Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-09-15T08:03:48.486910Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:03:52.378002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:03:53.693392Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T08:03:53.727341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:03:53.679Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9cc3ff2b-7798-4c3d-959e-523ab97786f6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37070 10.133.0.36:443 10.134.0.9:45434 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:03:53.718Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 8 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "8525be08-22a0-499f-b73a-1d64780a2b1c" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37070 10.133.0.36:443 10.134.0.9:45436 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:03:56.370140Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:04:00.581472Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:04:07.741363Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T08:04:07.769508Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T08:04:07.928328Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:04:07.727Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b219e561-1486-4eb8-bccb-2b87e86045b9" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37078 10.133.0.36:443 10.134.0.9:50764 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:04:07.759Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "224cdccb-8185-4883-99ad-092abdc2c5ee" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37078 10.133.0.36:443 10.134.0.9:50770 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:04:07.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 305 19 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "3cdc9f9c-4a40-4984-8cf6-e63825507391" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:51848 10.133.0.36:443 10.134.0.9:50784 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:04:07.832Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "743fd97b-9fb1-40c8-91fe-ec6d03dcb3be" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:50792 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:04:07.888Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "1a413446-f496-40a1-ba02-b48cd14532b6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:50808 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T08:04:07.919Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 8 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "aa669ae8-2a03-454f-9cc3-2af9ff6db3f0" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:37070 10.133.0.36:443 10.134.0.9:50824 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T08:04:10.084586Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
[2026-09-15T08:04:15.344Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 39 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c5dbc470-bc18-4436-a301-1191e5442d74" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:44550 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T08:04:17.870621Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:04:21.407729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T08:04:21.387Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c3c75c34-bb8b-4375-ab6c-6e20628b13cc" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.133.0.101:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:60300 10.133.0.36:443 10.134.0.9:45966 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:04:21.428Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 30 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "565d57b2-79d5-4512-bcfc-8ca7080805e0" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:46682 10.133.0.36:443 10.134.0.9:45980 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T08:04:21.578Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "0fe90bdb-0fd6-482e-892b-a5e38a57ed85" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:46682 10.133.0.36:443 10.134.0.9:45994 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T08:04:21.715Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "5780ca22-c539-4b2b-a1c1-d2c8789241da" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:46682 10.133.0.36:443 10.134.0.9:45998 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T08:04:21.852Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "569064a8-0dec-4d7d-b903-cd2a698eff9b" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.36:443 10.134.0.9:46002 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T08:04:24.670963Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:04:30.354646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9
2026-09-15T08:04:34.495992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T08:04:34.475Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "5039c097-1b71-42bf-8f1b-d0663ec23143" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.78:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.36:39820 10.133.0.36:443 10.134.0.9:44060 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T08:04:34.524Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "54b41395-f65f-431b-ac48-a57ff59322f6" "maas.apps.5da0dc92-ed9a-46bb-8441-08824df2d089.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:36496 10.133.0.36:443 10.134.0.9:44072 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T08:04:37.674426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=9