2026-09-15T20:50:54.167832Z	info	FLAG: --concurrency="0"
2026-09-15T20:50:54.167850Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-15T20:50:54.167854Z	info	FLAG: --help="false"
2026-09-15T20:50:54.167857Z	info	FLAG: --log_as_json="false"
2026-09-15T20:50:54.167859Z	info	FLAG: --log_caller=""
2026-09-15T20:50:54.167861Z	info	FLAG: --log_output_level="default:info"
2026-09-15T20:50:54.167863Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-15T20:50:54.167868Z	info	FLAG: --log_target="[stdout]"
2026-09-15T20:50:54.167870Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-15T20:50:54.167872Z	info	FLAG: --outlierLogPath=""
2026-09-15T20:50:54.167875Z	info	FLAG: --profiling="true"
2026-09-15T20:50:54.167877Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-15T20:50:54.167879Z	info	FLAG: --proxyLogLevel="warning"
2026-09-15T20:50:54.167882Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-15T20:50:54.167884Z	info	FLAG: --stsPort="0"
2026-09-15T20:50:54.167886Z	info	FLAG: --templateFile=""
2026-09-15T20:50:54.167887Z	info	FLAG: --tokenManagerPlugin=""
2026-09-15T20:50:54.167890Z	info	FLAG: --vklog="0"
2026-09-15T20:50:54.167893Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-15T20:50:54.168035Z	info	Proxy role	ips=[10.134.0.44] type=router id=maas-default-gateway-openshift-default-78bb78ff78-kwffw.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-15T20:50:54.168084Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-15T20:50:54.169171Z	info	cpu limit detected as 2, setting concurrency
2026-09-15T20:50:54.169385Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-15T20:50:54.169396Z	info	JWT policy is third-party-jwt
2026-09-15T20:50:54.169399Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-15T20:50:54.171125Z	info	Starting default Istio SDS Server
2026-09-15T20:50:54.171146Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-15T20:50:54.171164Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-15T20:50:54.171489Z	info	Opening status port 15020
2026-09-15T20:50:54.172823Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-15T20:50:54.173557Z	info	sds	Starting SDS grpc server
2026-09-15T20:50:54.173574Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-15T20:50:54.174116Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-15T20:50:54.174989Z	info	Starting proxy agent
2026-09-15T20:50:54.175025Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-15T20:50:54.230528Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=8
2026-09-15T20:50:54.230832Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=8
2026-09-15T20:50:54.236813Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-15T20:50:54.274634Z	info	cache	generated new workload certificate	resourceName=default latency=100.974052ms ttl=23h59m59.725370595s
2026-09-15T20:50:54.274673Z	info	cache	Root cert has changed, start rotating root cert
2026-09-15T20:50:54.274713Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.72528819s
2026-09-15T20:50:54.324340Z	info	ads	ADS: new connection for node:1
2026-09-15T20:50:54.324393Z	info	cache	returned workload certificate from cache	ttl=23h59m59.675608068s
2026-09-15T20:50:54.324707Z	info	ads	ADS: new connection for node:2
2026-09-15T20:50:54.324774Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.675226793s
2026-09-15T20:50:54.367051Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:00.726436Z	info	ads	ADS: new connection for node:3
2026-09-15T20:51:00.726598Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T20:51:00.726664Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-15T20:51:00.884430Z	info	Readiness succeeded in 6.71949819s
2026-09-15T20:51:00.884703Z	info	Envoy proxy is ready
2026-09-15T20:51:01.261458Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:14.785355Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:24.884974Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:41.692353Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:48.113610Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:51:56.110879Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:52:07.018058Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:53:56.179940Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T20:53:56.149Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 30 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "7f7d3f5a-2c7c-48a9-be6b-d25d50b3bce5" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:54708 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T20:53:56.266269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:53:56.644121Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
[2026-09-15T20:53:56.227Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 38 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "82e17a4b-8edc-4950-b447-33e62183b2b7" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:54714 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:53:56.319Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 337 57 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "2b1503ef-d8ca-4d6f-93ae-9d2bf2496285" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:54730 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.418Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 344 23 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "a23da7c7-987d-4748-9b34-02f5f2df4cf1" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:54746 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.471Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 319 16 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "b39d6ea7-177a-4f70-b28f-66dc1ee4c664" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:54754 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.518Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 323 18 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "a9671d66-ef35-4637-ba8d-89d9afad3939" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:54758 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.559Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 485 16 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "94a492d5-5a40-46a9-ad8e-9cb85828f5d6" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:54764 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.602Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 403 16 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "2454501b-462a-462c-a732-03909a3c8372" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:54774 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.641Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "f7325359-a131-4187-a3f5-01275627cb47" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54788 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.686Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "b050729a-af2d-46e9-8828-6a15261fb11c" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54804 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.728Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "008f838e-afce-458f-bd72-53344313a80f" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54818 - llm.facebook-opt-125m-simulated-kserve-route.3
2026-09-15T20:53:56.883062Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:53:57.141054Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:53:57.184483Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T20:53:56.764Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "5c779225-69c3-9895-8fac-d2db03ba7ba0" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54830 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.802Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "5d6cee25-6cbe-4dbb-80d8-6573b51bc018" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54834 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.839Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 88 4 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "0da9784b-723a-4515-aaa8-782fc46177ed" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:54844 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-15T20:53:56.867Z] "DELETE /v1/api-keys/0858bac6-0fb2-444e-9a2b-4d6e4e457e0d HTTP/1.1" 200 - via_upstream - "-" 0 365 15 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "f3d5caea-da3a-49a3-8a78-158fb6913202" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:54850 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:53:57.136Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "b5f726c8-8230-418f-8c62-e5e0f16af80b" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:54864 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T20:53:57.171Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.134.0.13" "curl/7.76.1" "d7f8a249-d85a-4404-84db-202a76a17566" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:54866 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T20:54:08.419367Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:08.500073Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:08.552928Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:08.598600Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:08.598818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:08.599010Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-15T20:54:08.644586Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:08.644725Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T20:54:08.673854Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:54:08.413Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2905a87b-98ed-43f4-943b-407c270aaed5" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40142 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T20:54:08.452Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 -  - "-" 20 88 6 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "9f1a10b6-57aa-4ca5-9951-2b9465089d39" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.134.0.13:40148 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.487Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "7005d324-ead2-4e27-8eca-b6a4ce42f241" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40158 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.538Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e4eea078-c664-4f36-a246-56bff9e07a8d" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40166 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.575Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 22 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "31c5b53f-f5a1-463a-a5ab-03c6735dae4e" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40174 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.578Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e8d0fde7-0dee-42ea-8662-434eb3aea294" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:40188 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T20:54:08.621Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 11 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "15d7a48f-6149-428b-9cef-c1512f92c851" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.134.0.13:40194 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.629Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "7dc6260b-b004-4256-bede-5ae27b24a1ff" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:40200 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:08.659Z] "DELETE /v1/api-keys/61b19d17-aa79-4251-9011-376d3cbd4f22 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "a66ede0a-c6fd-4e02-ab39-8f85bfd48768" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40210 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T20:54:08.858640Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-15T20:54:08.861527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:08.895571Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:08.989702Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:09.041325Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:09.065982Z	info	ads	ADS: new connection for node:4
2026-09-15T20:54:09.068573Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-15T20:54:09.068611Z	info	cache	read certificate from file	resource=file-root:system
2026-09-15T20:54:09.238190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:09.282074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:09.354798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:09.396859Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:54:09.590072Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T20:54:08.847Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "78886271-7331-45b6-9861-20aa406e47dc" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40220 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.881Z] "DELETE /v1/api-keys/526df5b9-a22d-48c8-843c-a084820c6d41 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2fa1bca1-8b82-43f2-b456-18e04098df18" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40234 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.919Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "69d0ba90-570d-4eb9-9f70-b9129eb53407" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.134.0.13:40240 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:08.976Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 13 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "949379d2-2359-4741-9426-ba332c7181b4" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40254 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.025Z] "DELETE /v1/api-keys/2fe458e3-d078-4673-9dc9-e73d68c67c89 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "f39e19eb-3ec0-48c8-a28f-8e3c73d35757" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40260 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.224Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "598cd6c1-e31a-4cd4-884c-655e716e4a69" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40270 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.264Z] "DELETE /v1/api-keys/f070a512-d968-4614-b721-a6d01e53dd9c HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "f687fe29-82b7-44c0-a152-984ad6c61401" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40272 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.301Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 10 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e76f48ec-8041-9f61-b39a-eb712fb7bcd1" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.44:443 10.134.0.13:40280 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.339Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "5b405806-9e97-4fac-af52-ac169606ca1d" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40284 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.382Z] "DELETE /v1/api-keys/7a31dbd3-3ebe-44cd-b20f-68503bcef8c2 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "365d67c2-9e63-433d-ad1f-d79e2e77d84d" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40296 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.572Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "4faefb60-3e2e-428c-987b-86cf5697db99" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40302 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.611Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 77 12 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2963fc4d-45c5-408e-9276-225b82093109" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:40310 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T20:54:09.812613Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:09.953868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:54:09.797Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "779191e6-dc6c-41ad-8fa9-de260c6ccdc0" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45158 10.134.0.44:443 10.134.0.13:40324 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:09.840Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "7e284e0c-23dc-4912-a0e5-d37b28c7d9f6" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:40334 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:09.883Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 22 - "52.71.36.72,10.134.0.13" "-" "c07f6235-7379-4857-a357-524f8a38892b" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:40350 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:09.936Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 17 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "a67f6248-3194-49f3-a4e3-c881bd6b7bf7" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:40352 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T20:54:14.274310Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T20:54:15.088Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 12 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "ed79b833-431d-4447-b0d2-d634a4d5c5ad" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:35920 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:15.963Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 7 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "570ae285-942c-4877-a7c5-6c6101595902" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" - - 10.134.0.44:443 10.134.0.13:35930 - -
2026-09-15T20:54:16.477624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:54:16.461Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "a8a4430a-5e1c-4c0a-b9ae-76b786e4884d" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:35944 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:16.879Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 10 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "4cb51621-b596-418e-b435-2ce000d89a76" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.44:443 10.134.0.13:35950 - llm.e2e-external-model.0
[2026-09-15T20:54:16.914Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 88 7 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "090992c8-30ea-4fe5-ad7c-5d166c10aad3" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.44:443 10.134.0.13:35956 - llm.e2e-external-model.0
2026-09-15T20:54:17.365943Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:17.366099Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-15T20:54:16.944Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 421 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "69178c43-fb6b-4701-8cf7-6196f8639f52" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:48564 10.134.0.44:443 10.134.0.13:35958 - llm.e2e-external-model.1
2026-09-15T20:54:22.559291Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T20:54:30.112Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 11 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e1e5f404-b607-461e-bb4b-87bb3a31ce46" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" - - 10.134.0.44:443 10.134.0.13:35592 - -
2026-09-15T20:54:34.015278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:34.015462Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-15T20:54:34.241772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:34.241932Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-15T20:54:33.893Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 121 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "eca622cf-2cc0-4990-80ea-95d19a7cf611" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:46444 10.134.0.44:443 10.134.0.13:38618 - llm.e2e-external-model.1
[2026-09-15T20:54:34.039Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 202 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "cbf216d0-9fc0-4a00-8f2a-73ba3f7bb471" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:46444 10.134.0.44:443 10.134.0.13:38624 - llm.e2e-external-model.2
2026-09-15T20:54:34.405896Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T20:54:34.406041Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-15T20:54:34.264Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 141 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c27c09cc-0679-416b-bfc2-e0dd35ae8b69" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.44:46444 10.134.0.44:443 10.134.0.13:38634 - llm.e2e-external-model.2
2026-09-15T20:54:35.720115Z	info	ads	ADS: "" 4 terminated
2026-09-15T20:54:37.571713Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:54:53.970192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T20:54:55.603743Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:54:55.587Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "01288da0-474f-4314-8ed0-12aca6cd627c" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:37872 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:55.635Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 171 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "f6bb68f9-d220-4233-9cbb-b1f84c6cd9b9" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:37888 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T20:54:57.620255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:54:57.605Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "1ad52a97-1340-4131-b5bf-b1759dbd3998" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:37902 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T20:54:57.662Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c9630593-f25c-4f9a-8390-cd7cbd479fac" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:37910 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:57.703Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "333b25c7-f1be-4f05-abfc-ca82ab966038" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:37914 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:57.742Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "560a9701-0784-4244-b03c-854142b41b0a" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:37916 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T20:54:57.782Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2e1d4ee4-5fc3-4faf-9845-39553d3671ce" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:37924 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T20:55:10.580924Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T20:55:10.738909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T20:55:10.256Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "14fc2ff6-5e9c-4473-a8a1-5d1415b39b37" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" - - 10.134.0.44:443 10.134.0.13:34112 - -
[2026-09-15T20:55:10.404Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "f5ea1e51-59d5-4d62-9b10-a6ab86d45ef5" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" - - 10.134.0.44:443 10.134.0.13:41808 - -
[2026-09-15T20:55:10.550Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "747ee188-2c97-4e9f-b420-73b12cdb71f6" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" - - 10.134.0.44:443 10.134.0.13:41816 - -
[2026-09-15T20:55:10.576Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "3fae6c02-1227-42cc-9c45-9969838688ea" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:41828 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-15T20:55:10.720Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2e8b2658-fe79-4fc5-a670-ecb5c3311ffc" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:45170 10.134.0.44:443 10.134.0.13:41832 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:05:43.662729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:06:02.446544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:13:10.807528Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:13:10.777Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 29 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "45845fbc-f341-4ba5-8dd1-1a2baa21a3b4" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:46518 10.134.0.44:443 10.134.0.13:47032 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:13:10.839Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 326 32 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "7217b258-5268-4887-880f-1398694ab0b3" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:47042 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-15T21:13:10.901Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "28902e16-13ed-4351-a44e-d3572fd85d48" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:47044 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-15T21:16:31.304429Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:16:31.284Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "66454c7e-f3e4-49a8-8f44-16cea93f6ad8" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:49246 10.134.0.44:443 10.134.0.13:52242 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:16:33.176003Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:16:33.159Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c7a3b94e-c6a7-4e95-981e-f536952817d5" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:49250 10.134.0.44:443 10.134.0.13:52254 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:16:34.136630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:17:55.820553Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:17:56.341287Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:17:56.324Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 17 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "ca6d320e-056a-4f3d-878f-8cd603bbc9f5" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:53940 10.134.0.44:443 10.134.0.13:52632 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:18:19.528762Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:18:23.106522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:18:23.076Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 29 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "943e41ce-5a86-4097-a9b3-213b070829ec" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:34298 10.134.0.44:443 10.134.0.13:57302 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:23.129Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 44 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "3ddb9597-d052-4069-92b9-56649989713b" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41856 10.134.0.44:443 10.134.0.13:57306 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:23.294Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "ccab1609-28a5-4ee3-a8f7-1964b029e8a3" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41856 10.134.0.44:443 10.134.0.13:57312 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:23.441Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "261295fc-9c7d-4261-8ab2-f0a0c576e342" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41856 10.134.0.44:443 10.134.0.13:57318 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:23.582Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "ab6c5ec9-1670-4b22-8538-c6a1a8a929d1" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41868 10.134.0.44:443 10.134.0.13:57324 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:23.738Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "dce02567-7710-401e-855d-38a042cf9c3c" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41856 10.134.0.44:443 10.134.0.13:57326 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:23.882Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "3b9288d7-2b76-4504-b583-bcefb6f50357" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:57328 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:27.936387Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:18:32.578016Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T21:18:32.721002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T21:18:33.513662Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:18:32.562Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "dccb9324-f08e-479d-8db0-b822e6cfb924" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:34298 10.134.0.44:443 10.134.0.13:49742 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:32.597Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e52544c7-29d0-4320-8a35-215ff84f6ac3" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41868 10.134.0.44:443 10.134.0.13:49748 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:32.637Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "51b6e40b-95ca-431c-be6a-539d8a9d7d1c" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:49756 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:32.673Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "15a5e336-fb31-42b8-9cee-b1584b99c21a" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:49772 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:32.705Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e7b27278-57ac-46b4-a413-a25553a013a9" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41868 10.134.0.44:443 10.134.0.13:49784 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
[2026-09-15T21:18:33.499Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "18e501b1-f8b6-4a45-983f-7cd22df8bdc6" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:53940 10.134.0.44:443 10.134.0.13:49798 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:33.535Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2529c8d0-7a56-41dd-999e-3ada793c834d" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:49802 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:34.518Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c2ec0430-75fc-4888-8746-b4de32d97709" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:49806 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:35.292Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "043bde70-3239-45b7-b9f7-97d6b4ca7561" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33848 10.134.0.44:443 10.134.0.13:49820 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:35.734300Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T21:18:36.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "0bc998d1-69ca-4fb3-9159-72b7b6f7fbdb" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:49832 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:41.914Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 96 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "79ab5bb7-ef1c-4380-8780-afec15025963" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:44998 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:18:47.063Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 171 12 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "53ed32b1-795b-4bba-b325-9eb1c53c32dd" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:45006 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:47.945226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:18:47.929Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "5a5c872d-5145-4d5c-99ba-7bc99290652f" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:34298 10.134.0.44:443 10.134.0.13:45008 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:48.314Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 96 11 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "23b732a7-eab3-4363-8c06-bfa5dc030a63" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:45022 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:50.936612Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:18:54.958232Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:18:56.401231Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:18:56.385Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "8fcb9c05-bf39-4ad5-961f-a438bd65cc9b" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:53940 10.134.0.44:443 10.134.0.13:57306 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:56.427Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "f29e4387-e146-459e-ba7e-93ddc959c3e2" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33846 10.134.0.44:443 10.134.0.13:57310 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:57.842510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:18:57.826Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 15 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "37af2c25-9c3c-4988-b4c3-122a6e9b546c" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:53940 10.134.0.44:443 10.134.0.13:57312 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:18:58.226Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 96 12 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "e7801e3f-53e1-42d7-9071-38caa7c6867e" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:57314 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-15T21:18:58.940354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:20:04.326530Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:20:04.308Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 17 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "a730b71b-e12f-4c54-b869-500fbf13b040" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:59870 10.134.0.44:443 10.134.0.13:54994 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:20:04.354Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 113 22 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "068c7a35-538b-4dbc-9d4a-07c193c17683" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:55010 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-15T21:20:25.334656Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:20:26.672234Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:20:26.020Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 291 33 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "0feaeec1-6173-45d2-bf9f-a9e471784fac" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:33296 10.134.0.44:443 10.134.0.13:50484 - llm.e2e-trlp-test-simulated-kserve-route.0
[2026-09-15T21:20:26.656Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "d6a27100-7356-4e16-ab9a-63b47520b816" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:59870 10.134.0.44:443 10.134.0.13:50494 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:20:29.331478Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:20:33.546347Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:20:35.127651Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:20:35.110Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 17 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "7415eba2-90c1-4fa6-8020-4d640d164a49" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54824 10.134.0.44:443 10.134.0.13:56542 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:20:35.274356Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:20:35.263Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "a31939fb-b625-487f-b5ad-baacd142a6a4" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54824 10.134.0.44:443 10.134.0.13:56546 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:20:37.436447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:20:47.036039Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:21:10.442561Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:21:28.746153Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-15T21:21:28.786028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:21:28.729Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c069e9ec-e217-4f7a-b8a2-327c2c3b7e77" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54824 10.134.0.44:443 10.134.0.13:45478 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:21:28.772Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 13 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "5e81c7db-2062-4848-9888-5f38af8baef7" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54824 10.134.0.44:443 10.134.0.13:45492 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:21:33.336295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:21:33.622694Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T21:21:34.012519Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:21:33.604Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 18 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "58fdadb8-8d5e-9c4d-b883-01451eec0446" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47996 10.134.0.44:443 10.134.0.13:59644 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:21:33.976Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 36 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "bd17018a-0d17-4bba-b56a-3738135aaf10" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47996 10.134.0.44:443 10.134.0.13:59660 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:21:37.835543Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:21:46.131814Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T21:21:46.163444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-15T21:21:46.312695Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:21:46.114Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "cfa6d01b-d91c-4415-bf54-44d00e2be24b" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47996 10.134.0.44:443 10.134.0.13:56786 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:21:46.151Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 12 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "fa119d5c-03d8-4fe8-bddf-159dbbc75206" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47996 10.134.0.44:443 10.134.0.13:56794 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:21:46.183Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 300 19 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "169269fc-e5e5-4f37-8983-0f3ccb3d5b63" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:41856 10.134.0.44:443 10.134.0.13:56802 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:21:46.225Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 13 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "165fa927-481e-4d26-a5ad-1aa011e96eea" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:56816 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:21:46.263Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c04941c2-1715-4f9c-92b5-321eda4a219a" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:56830 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-15T21:21:46.302Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "55354710-807f-41bb-8f22-609db94f57ec" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:47996 10.134.0.44:443 10.134.0.13:56838 - odh-ai-gateway-infra.maas-api-route.3
2026-09-15T21:21:48.232300Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-15T21:21:54.115Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 103 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "0c6c8dc9-9ee4-4d36-823a-8bff5f357757" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:51388 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T21:21:56.476266Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:22:00.234327Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-15T21:22:00.217Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "69cf9075-f12d-4a25-97d4-451566c4730f" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:54824 10.134.0.44:443 10.134.0.13:51402 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:22:00.251Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2b55ed3b-d41d-4a73-a59a-38d1b0d710a7" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:36780 10.134.0.44:443 10.134.0.13:51412 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T21:22:00.403Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 21 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "2bd5f2db-ffaa-4109-839c-50f6d31c0b23" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:44304 10.134.0.44:443 10.134.0.13:37412 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T21:22:00.546Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 21 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "caa25ea0-fde1-458c-a98d-eb76bc207890" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:44304 10.134.0.44:443 10.134.0.13:37414 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-15T21:22:00.686Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 16 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "c196d0f9-dafe-4ee7-950a-46f6c5691883" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.44:443 10.134.0.13:37424 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T21:22:04.173418Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:22:08.337478Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:22:16.771908Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-15T21:22:16.751Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 20 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "545b4684-ec05-4354-8978-814acc36fd0e" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.133.0.75:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.44:38712 10.134.0.44:443 10.134.0.13:39720 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-15T21:22:16.796Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "52.71.36.72,10.134.0.13" "python-requests/2.32.5" "5c67cf22-7879-4fc8-a5c2-66ac744ecf7f" "maas.apps.83316c0c-b59e-4834-9e27-b39197fb8026.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.44:36780 10.134.0.44:443 10.134.0.13:39722 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-15T21:22:18.730860Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-15T21:22:23.034288Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2