2026-09-15T12:12:41.556235Z	info	FLAG: --concurrency="0"
2026-09-15T12:12:41.556256Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-15T12:12:41.556259Z	info	FLAG: --help="false"
2026-09-15T12:12:41.556262Z	info	FLAG: --log_as_json="false"
2026-09-15T12:12:41.556264Z	info	FLAG: --log_caller=""
2026-09-15T12:12:41.556266Z	info	FLAG: --log_output_level="default:info"
2026-09-15T12:12:41.556268Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-15T12:12:41.556276Z	info	FLAG: --log_target="[stdout]"
2026-09-15T12:12:41.556278Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-15T12:12:41.556280Z	info	FLAG: --outlierLogPath=""
2026-09-15T12:12:41.556282Z	info	FLAG: --profiling="true"
2026-09-15T12:12:41.556284Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-15T12:12:41.556287Z	info	FLAG: --proxyLogLevel="warning"
2026-09-15T12:12:41.556289Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-15T12:12:41.556291Z	info	FLAG: --stsPort="0"
2026-09-15T12:12:41.556293Z	info	FLAG: --templateFile=""
2026-09-15T12:12:41.556294Z	info	FLAG: --tokenManagerPlugin=""
2026-09-15T12:12:41.556297Z	info	FLAG: --vklog="0"
2026-09-15T12:12:41.556300Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-15T12:12:41.556453Z	info	Proxy role	ips=[10.134.0.30] type=router id=maas-default-gateway-openshift-default-5ccb968c66-nv8bv.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-15T12:12:41.556521Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-15T12:12:41.557783Z	info	cpu limit detected as 2, setting concurrency
2026-09-15T12:12:41.558013Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-15T12:12:41.558025Z	info	JWT policy is third-party-jwt
2026-09-15T12:12:41.558028Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-15T12:12:41.559908Z	info	Starting default Istio SDS Server
2026-09-15T12:12:41.559929Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-15T12:12:41.559951Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-15T12:12:41.560811Z	info	Opening status port 15020
2026-09-15T12:12:41.561291Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-15T12:12:41.562606Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-15T12:12:41.563519Z	info	Starting proxy agent
2026-09-15T12:12:41.563552Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-15T12:12:41.581009Z	info	sds	Starting SDS grpc server
2026-09-15T12:12:41.581038Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-15T12:12:41.620042Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=8
2026-09-15T12:12:41.620369Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=8
2026-09-15T12:12:41.623360Z	info	cache	generated new workload certificate	resourceName=default latency=62.312183ms ttl=23h59m59.376643385s
2026-09-15T12:12:41.623391Z	info	cache	Root cert has changed, start rotating root cert
2026-09-15T12:12:41.623426Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.376574717s
2026-09-15T12:12:41.626032Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-15T12:12:41.714310Z	info	ads	ADS: new connection for node:1
2026-09-15T12:12:41.714381Z	info	cache	returned workload certificate from cache	ttl=23h59m59.285620856s
2026-09-15T12:12:41.714783Z	info	ads	ADS: new connection for node:2
2026-09-15T12:12:41.714847Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.285154882s
2026-09-15T12:12:41.758192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:12:47.563058Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:12:47.831401Z	info	ads	ADS: new connection for node:3
2026-09-15T12:12:47.831631Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T12:12:47.831731Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T12:12:48.034245Z	info	Readiness succeeded in 6.480526089s
2026-09-15T12:12:48.034660Z	info	Envoy proxy is ready
2026-09-15T12:12:55.367852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:13:22.585849Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:13:30.876858Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:13:42.707017Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:13:58.312918Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:14:07.532566Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:15:06.657657Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:15:06.626Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 31 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "88c650d2-73b1-43b5-95cc-52d3b7ef891a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:37090 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:15:06.740050Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:15:06.702Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "3c3b34f1-d65a-4179-a2ae-34ffc714ad54" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:37102 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:06.792Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 443 61 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "0326a96b-1a8f-46eb-96db-7eb915f87504" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:37104 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:06.898Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 354 17 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "e8cce02a-5928-4d80-b36f-e2b2a5dc080f" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:37108 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:06.942Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 383 17 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "183386d7-48a4-99c9-a58d-18c0cdb162ee" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:37118 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:06.987Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 357 17 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "580d5cfa-2e82-49c8-bb01-c197985764f8" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:37120 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.035Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 414 21 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "ffa1c10d-e55d-41c5-848f-d3cf51f4eda8" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:37128 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.080Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 15 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "705b878b-14af-4070-a6af-36c7d14f376e" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37144 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.123Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "61fa6ada-d069-4ee5-a733-b6bc53a8631a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37160 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.163Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 15 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "f890e590-fea9-4916-8de1-3155c58059be" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37162 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.206Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "3dd9cfc8-c6bc-4c77-be78-d71307be4aee" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37168 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.244Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "18d93fec-705c-4adf-8076-923bee24efdf" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37174 - llm.facebook-opt-125m-simulated-kserve-route.3
2026-09-15T12:15:07.370185Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:07.640893Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:07.677878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:15:07.282Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "8445b9b8-f87f-48c7-9da9-37a92f2e562c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37190 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.322Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 0 5 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "0651dc05-663f-476b-9842-1518c6c0dde4" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37206 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T12:15:07.354Z] "DELETE /v1/api-keys/948a43a6-8677-4bfb-b2c9-8b6ac17f9a6a HTTP/1.1" 200 - via_upstream - "-" 0 365 16 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "f51b6cfc-f06c-4c08-b361-2f3df5ffd71c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:37218 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:07.636Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "4bab5500-63b8-41bf-8978-6a4b149de32d" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:37228 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T12:15:07.664Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 13 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "d35efe1f-263c-4719-a11f-671a3f565906" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:37238 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:15:18.352203Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:18.427018Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.461604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-09-15T12:15:18.463987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.488030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-15T12:15:18.497012Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.505757Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:18.505936Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-15T12:15:18.551987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.552142Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T12:15:18.559169Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.728415Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.763549Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.827945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:18.865706Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:18.960994Z	info	ads	ADS: new connection for node:4
2026-09-15T12:15:18.963807Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-15T12:15:18.963911Z	info	cache	read certificate from file	resource=file-root:system
2026-09-15T12:15:19.033982Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:19.070306Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:19.143578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:19.179001Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:15:18.345Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 6 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "ead70241-e5c8-4c6a-8347-e9be72c2d744" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:57862 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T12:15:18.378Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 -  - "-" 20 0 7 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "409e95b4-0684-478f-82ed-08a3f0d6861e" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.9:57872 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.410Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "8c81b286-b0dc-93b1-8a18-2db4c58717f0" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57882 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.449Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 14 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2bdaed95-a96a-4a0b-95d3-ba7b9b85d016" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57886 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.482Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 14 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "9d39dc0c-ec18-4f26-abab-4ddc8e5d77f2" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57896 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.483Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 22 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "34e8cac7-eb0e-425e-8065-562bcaecaaff" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:57912 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T12:15:18.515Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 8 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0800c175-6592-42a2-a3d6-05fc357d6168" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.9:57918 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.530Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 21 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "24a9289c-89ec-49be-945d-4385b1c35212" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:57924 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:18.545Z] "DELETE /v1/api-keys/647f9482-c2a1-447b-befa-4e63e23d3cea HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "84ff4c7e-f6e3-4585-a6d6-59db1bf7367d" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57940 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.713Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "1b229845-5c7e-4f45-81c0-5ce2de9b0111" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57952 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.748Z] "DELETE /v1/api-keys/aedd182f-f4d1-4f01-8201-04f93105ff01 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "6d1dfbcb-61fb-45b4-8f43-8554db2a1582" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57954 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.782Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 12 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b6da8034-de00-4d26-9fc3-8e30f7117cad" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.9:57966 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.812Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "48fbe755-87a4-47f6-9c24-985302e3c304" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:57968 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:18.849Z] "DELETE /v1/api-keys/5692cb10-68fa-41cd-99fa-173bb3f2c2af HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0b02050e-940d-4942-b787-a23fc12f2085" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57984 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.018Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2b96daea-a7d5-4bbe-8564-aa6a660ba71e" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:57998 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.053Z] "DELETE /v1/api-keys/2f178043-e84b-4196-a78e-a626f626d71c HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "55de2299-f360-46cb-b88d-85bac3adf042" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58004 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.091Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 12 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "c4fa32aa-3998-4f2c-82af-2f0a629cac6c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.9:58006 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 20 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "504f8398-c64b-4aff-9ad2-055752000d09" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:58008 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.161Z] "DELETE /v1/api-keys/bce35511-76cd-4309-bdc3-6f37cf43b176 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "26c2be4c-7fdb-4ed7-9869-5c8fa7c7b169" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:58012 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:15:19.340874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:19.374952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:19.441354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:19.475525Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:19.634246Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:19.824852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:19.939847Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:15:19.324Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "42506078-1cdd-4fc7-8864-0c0490edaad7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58026 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.358Z] "DELETE /v1/api-keys/a21b4a6f-4408-410b-82bc-d114abead103 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b171f289-7960-4551-bd49-8d6f4d1ac4ac" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58028 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.395Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "45750b48-b817-4580-a257-d7cdce629097" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.9:58034 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.425Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0a263f44-5877-457a-a184-14010bfd296a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58050 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.459Z] "DELETE /v1/api-keys/48c4f304-a157-4353-a144-764588f45419 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d3ef1e06-abe5-499a-b8e5-1adc483b6533" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:58058 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.619Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "f59940ee-d061-49bb-9ab3-28ec0ccf318c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:58060 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.657Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 13 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "595d6945-f28c-4435-a11b-4de961e815c5" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:58070 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:19.807Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "cc9da06d-7a1d-49c7-b0a7-f61e68d1d4cc" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58076 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:19.844Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 21 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "4314597c-1491-43cc-87df-3890fc3ac4cc" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:58078 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:19.883Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 20 - "34.228.250.194,10.132.0.9" "-" "b979796b-4b6f-44ce-b3cd-a763a04027ff" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:58094 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:19.924Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "8dee2827-aa5a-42a0-aef3-a312c08bfde1" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43748 10.134.0.30:443 10.132.0.9:58108 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:15:23.873693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T12:15:24.967Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 13 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "30bc2553-af4d-4808-9e56-3b6e10944881" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:58120 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:15:25.971123Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:26.644277Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:26.644431Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-15T12:15:25.953Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "cc1bed6c-de8e-406b-bd82-85edce0a8c5a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:58134 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:26.336Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 12 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "f5a3de45-4e36-4a43-af3d-c2291e9b7e57" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.30:443 10.132.0.9:58138 - llm.e2e-external-model.0
[2026-09-15T12:15:26.372Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 7 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d0de9eff-3935-4a33-924b-15a3d4309b25" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.30:443 10.132.0.9:58148 - llm.e2e-external-model.0
[2026-09-15T12:15:26.402Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 242 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "630ba9fd-d10c-4aeb-8728-aa0048d1e7db" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:51016 10.134.0.30:443 10.132.0.9:58160 - llm.e2e-external-model.1
2026-09-15T12:15:30.640318Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T12:15:30.190Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a203146f-f429-42f1-be15-7f8a649a2f0c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.9:47722 - -
[2026-09-15T12:15:39.331Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 6 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "7bfd8a15-1d37-4668-b2ef-c0aded28b96f" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.9:41484 - -
2026-09-15T12:15:39.945692Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:15:39.925Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 20 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b04187e7-74a5-4a17-b222-0837b44f5945" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:41496 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:39.968Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0ebe844e-c301-4838-a544-8cf42208851c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:41510 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:15:43.217414Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:43.217699Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T12:15:43.309381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:15:43.309773Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T12:15:43.409308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:43.409561Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-15T12:15:43.041Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 175 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "101f7c9d-15e4-41f5-a522-4c586dfedcfb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:58188 10.134.0.30:443 10.132.0.9:41516 - llm.e2e-external-model.1
[2026-09-15T12:15:43.246Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 63 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "c1267eeb-180a-4193-9ef4-de281f853594" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:58188 10.134.0.30:443 10.132.0.9:41520 - llm.e2e-external-model.2
[2026-09-15T12:15:43.341Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 67 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2084c01e-07d9-45ce-ad3a-fff72ce45dcf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:58190 10.134.0.30:443 10.132.0.9:41526 - llm.e2e-external-model.2
2026-09-15T12:15:43.992880Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:15:43.977Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "4a2fc63f-fa9c-4e6a-ae41-fceddc44caca" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:41530 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:15:44.023Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 31 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3077c077-a015-4e4c-8658-6295d1e07309" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:41532 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:44.075Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "ad7979b6-bd3b-46f5-ba44-55a65d11abe6" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:41536 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:44.123Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 32 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "4f8a7f0e-fbda-4907-8214-500f6bc71c91" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:41544 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:15:44.177Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 20 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "13a7555a-c4aa-492e-8e0c-1dbe73e30e84" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:41546 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:15:44.579648Z	info	ads	ADS: "" 4 terminated with stream closed
2026-09-15T12:15:51.158416Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:15:59.119874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:15:59.266152Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:15:58.795Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b574ed75-34e9-4c43-86a3-391b0209fa24" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.9:37726 - -
[2026-09-15T12:15:58.947Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 4 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2f86bd31-1816-4f9d-a927-fa7ecb9080d2" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.9:37738 - -
[2026-09-15T12:15:59.088Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d8a3d982-7100-46c4-b7ca-4701b7f83e14" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.9:37754 - -
[2026-09-15T12:15:59.115Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "47e7aa47-7e41-4995-87e4-c8f3359eb5b7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:37762 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T12:15:59.252Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0ab809d3-4701-4255-a9cf-4bec9d023b4d" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:53464 10.134.0.30:443 10.132.0.9:37768 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:19:32.868162Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:19:49.073039Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:33:13.956343Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:33:13.938Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "baef3bdf-15bd-4a2f-9b80-18fc00637e45" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39266 10.134.0.30:443 10.132.0.9:42268 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:33:13.981Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 31 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "8e60ae73-f03b-48b8-91f5-c59c7cd7f4f7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:42282 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T12:33:14.033Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 324 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "5b737463-7aa5-46fc-8bd3-4c4106cbe5a7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:42286 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-15T12:36:54.295305Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:36:54.267Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 27 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a9a7e453-dc9b-4609-91a9-ec36c232a5e3" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:34480 10.134.0.30:443 10.132.0.9:55228 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:36:55.767254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:36:55.751Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "86de1728-f29d-432d-bd81-f9297295ab3a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:55374 10.134.0.30:443 10.132.0.9:55230 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:36:56.833420Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:38:17.225399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:38:17.623632Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:38:17.238Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 384 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "761d0c58-277e-4421-b007-f72fd72283e2" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43868 10.134.0.30:443 10.132.0.9:36170 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:38:41.334354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:38:44.689953Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:38:44.672Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 17 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3100861e-6535-469e-ab61-f950aa4827db" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43868 10.134.0.30:443 10.132.0.9:43846 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:38:44.711Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 47 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "ca603580-f350-46fb-9477-0c6e6b6ae2dd" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37042 10.134.0.30:443 10.132.0.9:43852 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:38:44.888Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "325748b9-a7a1-4552-96b7-77af597ec06e" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:43862 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:38:45.038Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d0ff3e1c-c713-4e00-8297-605c685e261c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:43872 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:38:45.177Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "28c2de09-166f-41f1-98e0-ff404f4a13ce" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:43880 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:38:45.316Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a6c12618-792d-4ca6-a507-601129d05b74" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:43896 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:38:45.454Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3f463b0e-4180-4986-821f-173b8e10ef97" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:43910 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:38:48.914812Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:38:53.226835Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:39:00.369625Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:39:00.530965Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:39:00.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 334 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d3b4bfce-789a-4d8b-80dc-1a001c8dc1f6" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:40924 10.134.0.30:443 10.132.0.9:42720 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:39:00.394Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 21 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "fd8aa74a-7580-4413-aef5-8041bc0023bb" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:42728 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:00.436Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b4666c82-b721-497f-aba5-51f1774ecf62" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:42742 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:00.477Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "40d5fd4c-9da0-4d83-af02-a6ac52d112a9" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:42758 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:00.515Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "6061677b-a7ea-4d88-9337-11e0cebdf971" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:42770 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
2026-09-15T12:39:01.242552Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:39:01.227Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 14 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "4bd6e0ef-4806-4acd-9fdc-734e72c2f1c4" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:40924 10.134.0.30:443 10.132.0.9:42772 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:39:01.267Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "1c4efbcc-7fda-4454-9319-a56b39958b1c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:42786 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:02.217Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2557942c-db81-4834-b15d-eaf759f5ac5f" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:42792 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:39:03.828878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T12:39:02.948Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "06a34cb9-b933-4fd0-93d6-73f0800dc169" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:42794 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:03.957Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "c76c5b83-78a5-4192-9773-d8222f0edb25" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59534 10.134.0.30:443 10.132.0.9:42806 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:09.361Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "28cb6f83-ffc2-4ceb-b692-8fde88790d9b" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:35366 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:39:14.398Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "954785f8-122a-4187-b1f8-411da754849f" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:35368 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:39:15.231194Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:39:15.215Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "da96d203-6e11-4de2-9159-3f2573f851c6" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:40924 10.134.0.30:443 10.132.0.9:35380 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:39:15.585Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3a9b4a52-0bfc-4df3-ad29-a4f99c6e9394" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:35396 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:39:18.227689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:39:22.318557Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:39:23.578795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:39:23.563Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "f8644204-68f1-90cc-8a2c-a7a383fb0fdf" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:40924 10.134.0.30:443 10.132.0.9:48582 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:39:23.600Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a1c759f8-461f-486b-b417-fc6f901a3c7c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:59520 10.134.0.30:443 10.132.0.9:48588 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:39:24.894246Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:39:24.878Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3b00e531-f033-4487-8792-6632b4012e91" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:43868 10.134.0.30:443 10.132.0.9:48602 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:39:25.245Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 12 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "956cb2e6-2b8c-41e6-990c-e3c5d33aefc7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:48610 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T12:39:26.521902Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:40:33.312230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:40:33.295Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "fdbb1af7-f14f-40fd-97da-32b7ef167b46" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:52546 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:40:33.336Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 49 20 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "fd7ed47e-756f-48fa-aa1b-667071afa203" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:52562 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-15T12:40:53.731477Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:40:55.321278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:40:54.688Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 37 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a57b1a1f-3e60-4ebf-a395-ce52c0afb8c4" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.33:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46404 10.134.0.30:443 10.132.0.9:40230 - llm.e2e-trlp-test-simulated-kserve-route.0
[2026-09-15T12:40:55.305Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "6a53f6d2-db61-40ee-a422-0d65509f443c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:40234 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:40:57.725969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:41:01.713256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:41:03.710313Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:41:03.854965Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:41:03.694Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "ca46d2f0-10c2-42bd-a71f-cb6da2a50c05" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:39568 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:41:03.841Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 13 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "96be1cdb-c862-4236-ad2c-88dcdc6c5d46" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:40324 10.134.0.30:443 10.132.0.9:39582 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:41:07.521868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:41:10.933539Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:41:40.746830Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:03.567267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:42:03.603727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:42:03.540Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 26 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "84cf4333-1049-4d20-9c6b-bc171f3812d1" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:34526 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:03.589Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 14 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "280b968b-6bd2-4caf-820a-99bb45c6291c" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:34534 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:42:08.241386Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:10.395591Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T12:42:10.437725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:42:10.380Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "89c08fd1-7963-4c76-8a76-2276b6eece46" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:46482 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:10.426Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "a4047288-1560-4f9c-b57a-5abf07bceff0" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:46494 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:42:13.636601Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:23.427798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:42:23.465963Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T12:42:23.650884Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:42:23.409Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "24d34099-6a2b-4a33-a2bc-9801b714fd35" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:33276 10.134.0.30:443 10.132.0.9:37970 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:23.453Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 12 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "dd058bc0-2709-478a-8f49-06e87bb2cc7a" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:33276 10.134.0.30:443 10.132.0.9:37972 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:23.488Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "9a6081a1-afc1-42f9-9a69-ab1e34e9cfa3" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37042 10.134.0.30:443 10.132.0.9:37980 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:42:23.530Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 18 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "5cb2b2f1-bb58-4ff7-b299-927c0fd881d3" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:37056 10.134.0.30:443 10.132.0.9:37986 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:42:23.567Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "26f7f88f-f86c-45be-8449-436eea471796" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:37988 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:42:23.605Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "d7cb58d6-d557-4793-870a-8a4108c26f25" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:38004 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T12:42:23.639Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "0060af0c-f8cd-41e2-8662-c551d631751b" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:33276 10.134.0.30:443 10.132.0.9:38018 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T12:42:25.748511Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T12:42:31.204Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 39 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "3a6aae5f-f469-461d-9391-f7fe836d9569" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:44860 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T12:42:33.734114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:37.345554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T12:42:37.329Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 16 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "19423e5b-be06-40f9-b17a-2da1b4e791ea" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39516 10.134.0.30:443 10.132.0.9:44868 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:37.369Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 34 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "2f55cb7f-e14b-4a6b-9f86-2504ed836207" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46016 10.134.0.30:443 10.132.0.9:44874 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T12:42:37.525Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 21 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "ea0f91b9-3335-4025-af6b-50da6bbd77b6" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46032 10.134.0.30:443 10.132.0.9:44876 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T12:42:37.672Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "1003390c-05c3-45e0-be43-b60d87fb06f7" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46016 10.134.0.30:443 10.132.0.9:44890 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T12:42:37.810Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 15 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "fe04fe6b-9787-4aed-b1f7-2da87682f8d1" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.9:44906 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T12:42:40.931356Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:44.821704Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T12:42:47.784171Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-09-15T12:42:54.629638Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T12:42:54.606Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 22 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "b665a9a7-7e98-4005-ba34-569902f8687d" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.132.0.92:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:58438 10.134.0.30:443 10.132.0.9:41602 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T12:42:54.654Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 32 - "34.228.250.194,10.132.0.9" "python-requests/2.32.5" "454cd5bb-12c8-4f25-a2cd-5f1998abf2e5" "maas.apps.8fd0702c-f14d-42cb-ad9c-253d826bfec9.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46016 10.134.0.30:443 10.132.0.9:41616 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T12:42:56.733281Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8