2026-09-20T02:03:52.201041Z	info	FLAG: --concurrency="0"
2026-09-20T02:03:52.201058Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-20T02:03:52.201062Z	info	FLAG: --help="false"
2026-09-20T02:03:52.201064Z	info	FLAG: --log_as_json="false"
2026-09-20T02:03:52.201066Z	info	FLAG: --log_caller=""
2026-09-20T02:03:52.201068Z	info	FLAG: --log_output_level="default:info"
2026-09-20T02:03:52.201070Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-20T02:03:52.201075Z	info	FLAG: --log_target="[stdout]"
2026-09-20T02:03:52.201078Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-20T02:03:52.201080Z	info	FLAG: --outlierLogPath=""
2026-09-20T02:03:52.201082Z	info	FLAG: --profiling="true"
2026-09-20T02:03:52.201084Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-20T02:03:52.201086Z	info	FLAG: --proxyLogLevel="warning"
2026-09-20T02:03:52.201088Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-20T02:03:52.201090Z	info	FLAG: --stsPort="0"
2026-09-20T02:03:52.201092Z	info	FLAG: --templateFile=""
2026-09-20T02:03:52.201094Z	info	FLAG: --tokenManagerPlugin=""
2026-09-20T02:03:52.201097Z	info	FLAG: --vklog="0"
2026-09-20T02:03:52.201099Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-20T02:03:52.201237Z	info	Proxy role	ips=[10.134.0.26] type=router id=maas-default-gateway-openshift-default-5ccb968c66-7ncht.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-20T02:03:52.201284Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-20T02:03:52.202376Z	info	cpu limit detected as 2, setting concurrency
2026-09-20T02:03:52.202630Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-20T02:03:52.202642Z	info	JWT policy is third-party-jwt
2026-09-20T02:03:52.202645Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-20T02:03:52.205130Z	info	Starting default Istio SDS Server
2026-09-20T02:03:52.205156Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-20T02:03:52.205180Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-20T02:03:52.205256Z	info	Opening status port 15020
2026-09-20T02:03:52.206432Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-20T02:03:52.206611Z	info	sds	Starting SDS grpc server
2026-09-20T02:03:52.206669Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-20T02:03:52.207698Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-20T02:03:52.208527Z	info	Starting proxy agent
2026-09-20T02:03:52.208564Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-20T02:03:52.265495Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=8
2026-09-20T02:03:52.265782Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=8
2026-09-20T02:03:52.271588Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-20T02:03:52.363394Z	info	ads	ADS: new connection for node:1
2026-09-20T02:03:52.363877Z	info	ads	ADS: new connection for node:2
2026-09-20T02:03:52.685514Z	info	cache	generated new workload certificate	resourceName=default latency=478.756424ms ttl=23h59m59.31449031s
2026-09-20T02:03:52.685548Z	info	cache	Root cert has changed, start rotating root cert
2026-09-20T02:03:52.685590Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.314410793s
2026-09-20T02:03:52.685608Z	info	cache	returned workload certificate from cache	ttl=23h59m59.314391823s
2026-09-20T02:03:52.685701Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.314303263s
2026-09-20T02:03:52.686054Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.313946668s
2026-09-20T02:03:52.728745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:03:58.467326Z	info	Readiness succeeded in 6.268420448s
2026-09-20T02:03:58.467605Z	info	Envoy proxy is ready
2026-09-20T02:04:15.474760Z	info	ads	ADS: new connection for node:3
2026-09-20T02:04:15.474939Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-20T02:04:15.475022Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-20T02:04:15.820286Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:04:27.441856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:04:35.127972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:04:44.341009Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:04:56.247732Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:05:01.663803Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:05:19.199760Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:06:37.922469Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:06:37.892Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 29 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "5db11e36-ad6d-432c-92e2-a20ea8e53fb2" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:38946 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:06:38.011776Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:38.731855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:06:37.977Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 34 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "0d1e68da-8070-4afc-b37a-120db902a371" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:38960 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:38.091Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 495 60 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "82e4b1d7-8544-4d92-b15f-f262f992997d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:38962 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.197Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 535 17 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "3a4b1a12-8a55-43ce-9c74-209d377fae49" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:38978 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.263Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 16 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "8b2f38d3-8c0f-462b-8f40-c194795515aa" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:38992 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.320Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "b0105b8a-0fbb-41ac-a0d9-430808ee7a5b" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:38994 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.364Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "bb3a574a-1aea-4456-93a0-705b132db87e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39006 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.410Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "04b16d3d-7079-4ead-acf5-731d83e71a3a" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39022 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.460Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "24ab51a3-9a3b-40ab-8e78-cd2ee7f815cf" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39024 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.509Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "29dee9b5-26ba-481b-befb-cfa0aacd5b68" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39038 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.548Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "a35b7c43-b0da-4a3d-b8af-1d82168ffd8f" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39040 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.588Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "1b6784ed-504f-4dc9-9e20-ef1659d25710" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39044 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.627Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "39a942fd-3903-474e-b39e-c0e5827463d7" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39052 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.683Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 0 5 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "de178e48-023e-4260-84e1-89d1b920c348" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:39054 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-20T02:06:38.715Z] "DELETE /v1/api-keys/7c0c5163-8fea-42b3-846f-0bd9a3af4b6b HTTP/1.1" 200 - via_upstream - "-" 0 365 16 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "9c93a801-31ad-44cd-af64-f6ef8f359126" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:39064 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:06:39.009217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:39.052952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:06:39.005Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "8c41c118-e213-4647-af53-49c55c141e79" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:39066 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-20T02:06:39.040Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "85dc13a1-a05f-4662-8d44-82aedd746a50" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:39070 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:06:54.641066Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:54.720987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-20T02:06:54.722079Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:54.757132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:06:54.780851Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:54.800772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:54.800936Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-20T02:06:54.847346Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:06:54.847499Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-20T02:06:54.852647Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:06:54.637Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1e8d41bf-2072-4353-913c-2bbc3a8ce9c3" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45572 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-20T02:06:54.665Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 -  - "-" 20 0 5 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "212bdc81-09aa-4a0a-84d6-9e1ff9e671c8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45576 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:54.708Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "41e191c8-5a56-4f17-a08d-8f60bf29d517" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45578 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:54.743Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "0fb9e027-7a60-4004-a920-8efd6bdf2667" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:45582 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:54.766Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "a4421b8e-16f8-4e4a-a331-19cfbfd42879" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45596 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:54.780Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 20 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "7e12697c-c7e9-4b33-8959-9dee2b7d5763" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:45602 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-20T02:06:54.802Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 8 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "70a935a5-b812-4370-8385-22b6391e9ad4" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45616 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:54.830Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "057df3a0-8218-4851-9c63-ad8ce6ae23ee" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:45626 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:06:54.838Z] "DELETE /v1/api-keys/0063bfa4-3a26-4845-825e-7a4668f62a8b HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "c4aa52a0-b2a5-4511-ae0e-e26a7b0233a4" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45638 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:06:55.026330Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.065260Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.136856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.171830Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.257724Z	info	ads	ADS: new connection for node:4
2026-09-20T02:06:55.260527Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-20T02:06:55.260568Z	info	cache	read certificate from file	resource=file-root:system
2026-09-20T02:06:55.355353Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.392931Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.472911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:06:55.509080Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-09-20T02:06:55.509197Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:06:55.704069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.742408Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.816658Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:55.850712Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:06:55.011Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "c8f30220-8d4d-4bb6-a4b4-950155c4ac26" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45642 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.050Z] "DELETE /v1/api-keys/16e06cdd-a8f5-45bb-9da0-2bfb283bb8ad HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b382d1bb-0f5c-4bda-ae89-f9de105fd79b" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45658 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.088Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ea83c07f-f051-4bb3-8171-2a1c6bcd53ab" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45668 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.122Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "93e60742-e50a-43f8-bcfe-ca0f657ff570" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45680 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.157Z] "DELETE /v1/api-keys/d864a2ba-1ba9-4c45-a7c8-6ea6234ea78e HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "17150ffb-e668-45a6-9d0e-5756546beec2" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45686 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.339Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "3c527115-5adf-48c4-ad73-d739cdeda6f8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45700 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.376Z] "DELETE /v1/api-keys/379b6088-bf4d-46a0-9e37-d4684cc74731 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ca3fb079-8d38-46ee-a39b-ccbda33cd05d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45706 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.418Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 12 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "a1fa1b55-4672-467d-ad49-b8801611ca69" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45720 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.454Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "3d83c109-6c08-4666-b93a-3b5d8de12b26" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:45734 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.492Z] "DELETE /v1/api-keys/428cd398-2334-49fb-9efd-2ccf34b9b523 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "00a44c34-d0d0-4d89-9e14-d4b9749841e5" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:45750 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.685Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "d0bc8998-72d3-4442-9973-95abc82c768d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45760 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.725Z] "DELETE /v1/api-keys/de03d3ab-51ce-46dc-abf0-8236a7aaac9c HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "6ae2cc8c-53a5-4aa7-9f88-cdfad3b6424c" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45766 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.762Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "bd9a8cb8-2dde-4f9a-a1a8-d1b0626925a8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45774 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.799Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "2041b553-fc0e-45b2-8391-70c91cb6d6ab" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45790 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:55.836Z] "DELETE /v1/api-keys/1d2cdb97-6e03-4ba1-8494-50b99ee1f336 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "5344c4eb-5e82-4ac4-bc30-dc0141cf3f4e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45802 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:06:56.018535Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:06:56.207190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:06:56.003Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "4f5ef0f7-345c-4697-9449-29366a804a7c" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45804 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:06:56.038Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 13 10 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "5463d45b-ad36-4703-a028-0f1239bd2a95" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:45806 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:06:56.192Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b4c67d0c-d028-43c2-9144-6b400b45b1cc" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45820 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:07:00.777429Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:07:02.377949Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:07:02.356Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 21 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ab090099-ee2a-4eff-afa1-2cd4ed562674" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:45832 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:07:03.160488Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:07:03.160633Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
[2026-09-20T02:07:03.033Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 10 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "dd84907d-4207-4c9a-b419-821d95cdfde0" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.26:443 10.132.0.14:45836 - llm.e2e-external-model.0
[2026-09-20T02:07:03.068Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 6 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "49213c17-e63d-4ea4-a855-72f5559cce6f" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.26:443 10.132.0.14:45844 - llm.e2e-external-model.0
[2026-09-20T02:07:03.099Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 61 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "21ae87b5-5764-4a44-91c0-ddad86c91ffb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.26:42494 10.134.0.26:443 10.132.0.14:45852 - llm.e2e-external-model.1
2026-09-20T02:07:04.344426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:07:04.239Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 20 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "0ccc11ee-dd15-4f28-9a9c-10ff17c3df5c" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:45868 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:04.286Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 17 - "52.71.36.72,10.132.0.14" "-" "08b5f575-5639-4169-9839-4f3d1d6579f8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:45870 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:04.330Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "88324acc-fc9f-49e0-a5d0-16463041bd1b" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:45886 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:07:07.188Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "f18bf826-bee9-4096-8359-ac8a0180e295" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" - - 10.134.0.26:443 10.132.0.14:35332 - -
2026-09-20T02:07:08.906086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:07:09.813Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "d11a704b-8e29-4468-96a5-22c3397f0ccc" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:35336 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:15.955Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 5 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "309c6e2d-3798-41f4-929a-9d207329d7ee" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" - - 10.134.0.26:443 10.132.0.14:54606 - -
2026-09-20T02:07:17.451080Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:07:18.540866Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:07:18.524Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ecfe7c87-9890-41e3-93e3-5442020e0065" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:54620 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:07:18.564Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "57003352-83ac-4542-bf2b-b26b45e3808b" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:54632 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:07:20.318542Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:07:20.318754Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-20T02:07:20.462341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:07:20.462646Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-20T02:07:20.540151Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:07:20.540291Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-20T02:07:19.897Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 421 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "97b33339-1cf4-467b-9f50-a4fb0d19e258" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.26:55882 10.134.0.26:443 10.132.0.14:54642 - llm.e2e-external-model.1
[2026-09-20T02:07:20.354Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 108 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "2c184016-96fe-476f-91c5-4dca013815a3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.26:55888 10.134.0.26:443 10.132.0.14:54654 - llm.e2e-external-model.2
[2026-09-20T02:07:20.487Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 53 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "998ebb0d-4497-49f0-a5b5-98fb178b2db4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.26:55882 10.134.0.26:443 10.132.0.14:54658 - llm.e2e-external-model.2
2026-09-20T02:07:21.754944Z	info	ads	ADS: "" 4 terminated
2026-09-20T02:07:22.755519Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:07:22.738Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "cf250948-91c9-4b46-b2ca-206f12f606d0" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58924 10.134.0.26:443 10.132.0.14:54670 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:07:22.795Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1773aed3-5b89-480c-bbf2-6579db4fb0a6" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:54684 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:22.836Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 34 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "abae7bc1-059c-4278-b6f5-6161bc8a1ac5" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:54700 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:22.895Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "834eb09a-3437-441a-8e97-f50f4bff2780" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:54710 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:07:22.938Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 34 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "4abdc720-ca3a-4aca-8d04-baea9d26e06e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:54724 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:07:27.401922Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:07:36.532324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:07:36.703199Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:07:36.148Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ce0fb289-3c78-4841-8f26-7cc127b59984" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" - - 10.134.0.26:443 10.132.0.14:59688 - -
[2026-09-20T02:07:36.332Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 4 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "d31da8bf-9f2d-43ec-b7ae-20b74ec008b4" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" - - 10.134.0.26:443 10.132.0.14:59692 - -
[2026-09-20T02:07:36.496Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 4 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "c288b85e-7f90-4b01-b184-201b344bc6ae" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" - - 10.134.0.26:443 10.132.0.14:59698 - -
[2026-09-20T02:07:36.528Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "6b0a0cce-7c23-437c-bfe0-eddb7abbc1aa" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:59706 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-20T02:07:36.688Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "77676329-97be-4d17-b09e-55952d55d4a3" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58936 10.134.0.26:443 10.132.0.14:59718 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:11:34.298951Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:11:46.301972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:25:57.983049Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:25:57.956Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 26 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "f08456c8-af2c-4b33-8b99-a0d6e65f8047" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:46000 10.134.0.26:443 10.132.0.14:37356 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:25:58.026Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 31 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "94bf1884-8153-4821-8326-b5c81dcc344e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:37358 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-20T02:25:58.078Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 319 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "531712ac-6fa8-44fb-981e-9692a1984cfd" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:37370 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-20T02:29:34.929638Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:29:34.912Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "da4b9868-6fee-4ab8-9745-bf3f0ab04c2e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:46840 10.134.0.26:443 10.132.0.14:53000 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:29:36.784245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:29:36.769Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "8b14a37c-218e-42db-8a69-3a1c31b3ebb4" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:46840 10.134.0.26:443 10.132.0.14:53012 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:29:37.785954Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:30:58.176719Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:30:59.998979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:30:59.984Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1454076c-0d06-422a-a9eb-5a9bb05ae10a" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:45698 10.134.0.26:443 10.132.0.14:32916 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:31:13.302013Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:31:13.276Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 25 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1eab9959-4062-41f5-9fd6-6bbe75e8efb8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:53380 10.134.0.26:443 10.132.0.14:52442 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:31:23.950Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 30 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b269fb8b-9f95-4f0b-84e0-35f484b75920" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:54792 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:24.001Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "28269f99-91c5-4c8e-a907-b8d0f3a0f0a8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:54798 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:24.052Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "af44940d-4bf5-49c8-a463-54586feb39a8" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:54802 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:24.098Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 8 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "41e39f28-3e74-493d-92b1-802c8ad5d3c7" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:54816 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:24.138Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 -  - "-" 66 0 5 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "4d193dbd-d18e-4e5d-8fd5-0e6b8347efc6" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:54832 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:24.169Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "9ecb4826-fad8-491d-97b8-552e13dd5855" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:54836 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:31:38.380058Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:31:41.996598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:31:41.972Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 23 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "14692ee0-074e-4b83-8633-ad5a65d99ff9" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:45698 10.134.0.26:443 10.132.0.14:59202 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:31:42.026Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 29 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "32069c2b-7d18-41a5-ae5f-918e2d43fbaf" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:59210 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:42.180Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b8323eb0-e67c-467a-b311-03e73981bc94" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:59216 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:42.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "26dca717-846f-4d81-8482-bfbb3c998554" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:59220 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:42.453Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ccdf931c-03bc-4ebe-8355-2308b13cd689" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:59224 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:42.598Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "35eda08d-9866-4fc3-8b32-0eb47aca3bc1" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38722 10.134.0.26:443 10.132.0.14:59236 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:42.734Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "73093fe5-95e4-4982-883f-b35b9e9c6c07" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:59244 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:31:46.610388Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:31:50.775880Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:31:57.646205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:31:57.844026Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:31:57.630Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "f41b94eb-da41-42f6-a805-5bdc8cf413ed" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:45698 10.134.0.26:443 10.132.0.14:44550 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:31:57.667Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "7ab40457-a902-4bed-b0c8-ba86cbab0d53" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:44566 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:57.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "82f3a384-434d-4790-8d9b-e291197af944" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:44574 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:57.761Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "02fa55d5-391f-45b6-add8-2cc2122f00e3" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:44582 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:57.799Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "e8d71ae9-0c95-4704-ba55-884194d35f02" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:44596 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:31:57.831Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 12 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "355230d7-238f-488d-b06b-08cee30e7154" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:44608 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
2026-09-20T02:31:58.572648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:31:58.558Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ff1a0b01-affb-4ecc-85d3-a7bc9f1f241d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:53380 10.134.0.26:443 10.132.0.14:44620 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:31:58.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "52e4b93b-ac28-4ded-9eb7-588562941cb4" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:44636 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:00.881203Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:32:01.695Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "46461342-584d-4f61-aaa8-64312d851f4f" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:44648 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:03.233374Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-09-20T02:32:05.177909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:32:04.547Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "7d17752a-6049-47d5-aca0-f0c52bdcbd13" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:42068 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:32:05.860Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "af8a03d5-ecfb-4997-879d-a652c9c38fdc" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:56460 10.134.0.26:443 10.132.0.14:42076 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:09.673529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:32:11.248Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "d00e194a-7f3c-4e37-aaa2-b922488f2d93" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:42080 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:13.877037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:32:22.537Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "f5778595-c7a0-4845-a9ed-5382467b5fc9" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:36344 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:23.365870Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:32:23.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "3d0bdfe5-f9c4-4fe6-b43f-844464f9aa65" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:45698 10.134.0.26:443 10.132.0.14:36346 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:32:23.720Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 10 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "8380298b-77a6-4392-a3fb-53b5b1830c35" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:36356 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:26.382877Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:32:30.283367Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:32:31.664270Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:32:31.649Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "a22dbae1-c73a-433c-9ef5-25cdb061677f" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:53380 10.134.0.26:443 10.132.0.14:34772 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:32:31.687Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "afd53a98-1130-46d7-a0b9-f4de560f3038" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.30:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:39064 10.134.0.26:443 10.132.0.14:34784 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:32.982284Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:32:32.967Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "39f8d3ff-87ec-4de4-8668-b42c5c3e08d1" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:53380 10.134.0.26:443 10.132.0.14:34790 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:32:33.346Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "af68d2e0-dec3-46c8-a9cd-723b1a94fa3d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:34792 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:32:34.378669Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:33:41.427100Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:33:41.409Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "364b4e97-030f-4b36-900a-1e5ddcddb37e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:41264 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:33:41.448Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 49 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "6acfc32c-cbfe-419d-be97-01e4fcf4af46" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:41276 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-20T02:34:02.674770Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:05.245864Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:34:04.626Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 292 32 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "c213beaf-dc2e-4a5f-bf91-f0202d85238e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.133.0.44:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:50448 10.134.0.26:443 10.132.0.14:52002 - llm.e2e-trlp-test-simulated-kserve-route.0
[2026-09-20T02:34:05.231Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "5f1d9395-933c-4e41-9de7-d15d26077674" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:52018 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:34:09.395921Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:11.604630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:34:11.749764Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:34:11.588Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "164c05ed-d772-425d-a8d0-fe45e8ab915f" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:52022 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:34:11.739Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "33e3a715-a497-4a38-a6d6-e992248c0201" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:52036 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:34:14.589663Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:22.482245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:29.103413Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:44.357381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:34:44.389123Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:34:44.341Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "55865a17-34c2-4547-95e4-740f2f701bb5" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:35204 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:34:44.377Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "ee90f421-c042-4538-9f17-18c7fe4df688" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:35212 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:34:49.283945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:53.680483Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:34:55.375159Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-20T02:34:55.407430Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:34:55.356Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 18 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b0a52063-9d21-4391-84ed-3d1f77c40cee" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:50226 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:34:55.395Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "2644aa1d-1463-4549-86e1-c44ff8e35c17" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:50238 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:34:57.683963Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:35:01.897456Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:35:06.379175Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-20T02:35:06.417319Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-20T02:35:06.363Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 15 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "8be552b3-0412-4c92-9256-f82a337c730b" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:57982 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:35:06.404Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "28e48ac7-b05d-43d5-980a-6fd966a266a5" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:58034 10.134.0.26:443 10.132.0.14:57984 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:35:06.441Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "2ef43576-6740-43d0-ad48-364e63e5257d" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.134.0.29:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:38716 10.134.0.26:443 10.132.0.14:57992 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:35:06.482Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "4d32e1c4-e5da-4a03-93da-53b687646fec" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:58004 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-20T02:35:06.562881Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:35:06.518Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "b960a59d-8f19-42ea-88f0-870f5f2b0b4e" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:58008 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-20T02:35:06.551Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "6f0e398b-0579-4a7e-ba8d-0c4e654d9582" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:58022 - odh-ai-gateway-infra.maas-api-route.3
2026-09-20T02:35:08.778163Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-20T02:35:14.066Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 39 17 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1bfbd3a6-c32b-48f7-9615-eab91e097cdd" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:58032 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-20T02:35:16.584892Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:35:20.203941Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:35:20.187Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "8e01d6ed-623e-4c2e-91a2-30ec2683fc54" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:51350 10.134.0.26:443 10.132.0.14:35180 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:35:20.222Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "9c3a3606-7675-4714-b5c8-747e5bf6b815" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:42626 10.134.0.26:443 10.132.0.14:35190 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-20T02:35:20.379Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1464bce9-c265-4265-9564-d6567957722a" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:42638 10.134.0.26:443 10.132.0.14:35196 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-20T02:35:20.521Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "99cd501a-ac67-49a2-ad96-398c33f56f13" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:42626 10.134.0.26:443 10.132.0.14:35208 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-20T02:35:20.659Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 16 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "1c236b4c-bccc-49cc-88bf-3c84568f3f55" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.14:35222 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-20T02:35:24.076171Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:35:28.075115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-20T02:35:36.469770Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-20T02:35:36.447Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 22 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "7ee88f5e-0de4-42ba-b307-2fe846899651" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.93:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.26:33426 10.134.0.26:443 10.132.0.14:53930 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-20T02:35:36.492Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "52.71.36.72,10.132.0.14" "python-requests/2.32.5" "9bab9f81-c888-47ed-b326-e3a624d7e216" "maas.apps.e451e460-3fa7-44e3-8b7f-2c4d76c6992a.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.26:42626 10.134.0.26:443 10.132.0.14:53944 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-20T02:35:38.775143Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8