2026-09-18T18:55:27.408844Z	info	FLAG: --concurrency="0"
2026-09-18T18:55:27.408873Z	info	FLAG: --domain="openshift-ingress.svc.cluster.local"
2026-09-18T18:55:27.408877Z	info	FLAG: --help="false"
2026-09-18T18:55:27.408880Z	info	FLAG: --log_as_json="false"
2026-09-18T18:55:27.408882Z	info	FLAG: --log_caller=""
2026-09-18T18:55:27.408884Z	info	FLAG: --log_output_level="default:info"
2026-09-18T18:55:27.408886Z	info	FLAG: --log_stacktrace_level="default:none"
2026-09-18T18:55:27.408891Z	info	FLAG: --log_target="[stdout]"
2026-09-18T18:55:27.408894Z	info	FLAG: --meshConfig="./etc/istio/config/mesh"
2026-09-18T18:55:27.408896Z	info	FLAG: --outlierLogPath=""
2026-09-18T18:55:27.408898Z	info	FLAG: --profiling="true"
2026-09-18T18:55:27.408901Z	info	FLAG: --proxyComponentLogLevel="misc:error"
2026-09-18T18:55:27.408903Z	info	FLAG: --proxyLogLevel="warning"
2026-09-18T18:55:27.408905Z	info	FLAG: --serviceCluster="istio-proxy"
2026-09-18T18:55:27.408907Z	info	FLAG: --stsPort="0"
2026-09-18T18:55:27.408909Z	info	FLAG: --templateFile=""
2026-09-18T18:55:27.408910Z	info	FLAG: --tokenManagerPlugin=""
2026-09-18T18:55:27.408913Z	info	FLAG: --vklog="0"
2026-09-18T18:55:27.408916Z	info	Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean
2026-09-18T18:55:27.409076Z	info	Proxy role	ips=[10.132.0.36] type=router id=maas-default-gateway-openshift-default-78bb78ff78-jlxh4.openshift-ingress domain=openshift-ingress.svc.cluster.local
2026-09-18T18:55:27.409134Z	info	Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}}

2026-09-18T18:55:27.410411Z	info	cpu limit detected as 2, setting concurrency
2026-09-18T18:55:27.410638Z	info	Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: ./etc/istio/proxy
controlPlaneAuthPolicy: MUTUAL_TLS
discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012
drainDuration: 45s
proxyAdminPort: 15000
proxyHeaders:
  envoyDebugHeaders:
    disabled: true
  metadataExchangeHeaders:
    mode: IN_MESH
  server:
    disabled: true
serviceCluster: istio-proxy
statNameLength: 189
statusPort: 15020
terminationDrainDuration: 5s

2026-09-18T18:55:27.410651Z	info	JWT policy is third-party-jwt
2026-09-18T18:55:27.410653Z	info	using credential fetcher of JWT type in cluster.local trust domain
2026-09-18T18:55:27.413199Z	info	Opening status port 15020
2026-09-18T18:55:27.412850Z	info	Starting default Istio SDS Server
2026-09-18T18:55:27.413262Z	info	CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel
2026-09-18T18:55:27.413281Z	info	Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem
2026-09-18T18:55:27.413918Z	info	xdsproxy	Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes"
2026-09-18T18:55:27.415182Z	info	Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc]
2026-09-18T18:55:27.416033Z	info	Starting proxy agent
2026-09-18T18:55:27.416064Z	info	Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2]
2026-09-18T18:55:27.433553Z	info	sds	Starting SDS grpc server
2026-09-18T18:55:27.433588Z	info	sds	Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket"
2026-09-18T18:55:27.473925Z	warning	envoy main external/envoy/source/server/server.cc:901	Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future.	thread=8
2026-09-18T18:55:27.474288Z	warning	envoy main external/envoy/source/server/server.cc:997	There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.	thread=8
2026-09-18T18:55:27.480677Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=1
2026-09-18T18:55:27.576127Z	info	ads	ADS: new connection for node:1
2026-09-18T18:55:27.576848Z	info	ads	ADS: new connection for node:2
2026-09-18T18:55:27.681579Z	info	cache	generated new workload certificate	resourceName=default latency=267.236369ms ttl=23h59m59.318426923s
2026-09-18T18:55:27.681630Z	info	cache	Root cert has changed, start rotating root cert
2026-09-18T18:55:27.681660Z	info	cache	returned workload certificate from cache	ttl=23h59m59.318343866s
2026-09-18T18:55:27.681671Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.318329129s
2026-09-18T18:55:27.681739Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.318261341s
2026-09-18T18:55:27.682038Z	info	cache	returned workload trust anchor from cache	ttl=23h59m59.31796299s
2026-09-18T18:55:27.726239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:55:33.693066Z	info	Readiness succeeded in 6.286970124s
2026-09-18T18:55:33.693339Z	info	Envoy proxy is ready
2026-09-18T18:55:51.841120Z	info	ads	ADS: new connection for node:3
2026-09-18T18:55:51.841270Z	info	cache	adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-18T18:55:51.841299Z	info	cache	read certificate from file	resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt
2026-09-18T18:55:52.089179Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:55:59.220977Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:56:18.205459Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:56:24.135060Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:56:33.637280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:56:41.236160Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:56:50.539191Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:58:35.672071Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T18:58:35.640Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 31 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "3ae0aecd-810d-4c73-902d-e1c3150c5796" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:43248 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T18:58:35.754721Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T18:58:35.720Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 34 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "3f508c62-cb85-4378-8583-d0a8d177acea" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:43250 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:35.812Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 341 58 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "4321c3a9-4f33-4e9e-8dfe-424c51569bb8" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:43264 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:35.915Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 318 24 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "bf5115d2-5bbd-4bb4-8c96-2380b0fd5304" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:43276 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:35.965Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 359 17 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "bd4b5ef2-6fb0-4280-955b-4165c5e0eb2c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:43284 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.012Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 325 16 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "40209fbf-7a54-42b9-9839-dff66fec5167" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:43300 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.063Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 386 17 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "e4a97d1a-cdd1-404d-b070-8fc4a5528fcb" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:43306 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.108Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 518 17 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "3fd4a8d8-c792-4471-a91f-dea7c208cbda" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:43322 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.152Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "c0b766bc-d44f-4ec2-b9b6-99181b3c1a38" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43328 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.195Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 14 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "c49ea07a-d886-4502-aaf0-e16c7f540dce" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43342 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.238Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "f66fdc09-0adc-4b3c-b18c-b2b2d585d281" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43352 - llm.facebook-opt-125m-simulated-kserve-route.3
2026-09-18T18:58:36.385544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=24
2026-09-18T18:58:36.399298Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:36.683885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:36.728243Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T18:58:36.277Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "55e36ee4-0299-4b9f-a2f3-377349ac634e" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43368 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.314Z] "POST /v1/chat/completions HTTP/1.1" 429 -  - "-" 122 18 13 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "e5eb9578-9d4b-4468-b8d6-7d67b606af53" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43384 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.352Z] "POST /v1/chat/completions HTTP/1.1" 401 -  - "-" 122 0 5 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "0d972a64-f3e9-424a-ac10-57063ca1b3a3" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43392 - llm.facebook-opt-125m-simulated-kserve-route.3
[2026-09-18T18:58:36.381Z] "DELETE /v1/api-keys/8696c308-3df8-47d1-b20d-d845cdcdec40 HTTP/1.1" 200 - via_upstream - "-" 0 365 17 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "d359d398-7b14-4545-a925-aff10386f926" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:43396 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:36.679Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "796fee19-94e5-4bb4-ad41-13de275e7cae" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:43410 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-18T18:58:36.713Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 15 - "52.71.36.72,10.133.0.11" "curl/7.76.1" "86b42f42-36ff-4a42-a69a-a7b5c1fcdb76" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:43414 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T18:58:46.486151Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.562342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.599140Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.638400Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.638731Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:46.638888Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
2026-09-18T18:58:46.680867Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.681020Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-18T18:58:46.705467Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth	thread=25
2026-09-18T18:58:46.705527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:46.886459Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.921902Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:46.987191Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:47.023967Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:47.146333Z	info	ads	ADS: new connection for node:4
2026-09-18T18:58:47.149377Z	info	cache	adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt
2026-09-18T18:58:47.149443Z	info	cache	read certificate from file	resource=file-root:system
2026-09-18T18:58:47.245427Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T18:58:46.482Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "4aca3422-d9e8-400b-8077-981feeb0be87" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50728 - odh-ai-gateway-infra.maas-api-route.4
[2026-09-18T18:58:46.510Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 -  - "-" 20 0 6 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "2e64a7cc-f38a-41ba-8937-99e4a8c8ad3a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50738 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.539Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 22 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "e5ca9650-741a-435a-aa33-f0d48a248536" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50748 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.584Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ba7d59a8-ca12-4b7f-9f25-7eb98d9aa774" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50762 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.623Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "e69876ed-fe71-43fa-8e40-4206c8114d03" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50768 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.618Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 20 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "15f10665-309a-415e-97d9-2a445361bc97" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:50764 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-18T18:58:46.657Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 83 0 8 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "a7c78b3f-09ff-45c9-aea0-b6fec2ed3730" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50782 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.663Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "b4cffe00-cfac-4264-96fd-9e8c3622db9f" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:50786 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:58:46.690Z] "DELETE /v1/api-keys/d1b3de9b-1b53-4a16-baac-20c25377e80a HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "9bdb06ce-9191-4554-a030-5fee919e32a2" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50796 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.871Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "009bb70f-61a9-4ee4-9b5c-c8cfefaa7032" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50806 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.907Z] "DELETE /v1/api-keys/49bda33f-2448-4cff-b236-46b3eac433e1 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "38f10a47-97dc-43d0-8743-724b8db493fe" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50808 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.941Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "9a4f1024-d2ef-4e17-9037-6d1cf85b43c0" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50816 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:46.972Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "32026bce-c2bf-41f4-8fa7-9885c902420b" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50832 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.007Z] "DELETE /v1/api-keys/d73b431a-ac41-49df-af90-fbe7a70f4d8e HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "6a2d055b-7a03-4216-8866-e652e7d55c49" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50842 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.226Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "acb6e9e9-7e5e-44bd-9b6f-55026a2b4588" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50854 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T18:58:47.281173Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:47.350772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:47.385479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:47.575383Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:47.618613Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:58:47.694214Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:47.729935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:47.909479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:48.113780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T18:58:47.265Z] "DELETE /v1/api-keys/6049f7aa-8042-423a-9b6a-b48e427061d5 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "8678102f-b313-4d9f-b2e4-5cb1dee16c05" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50860 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.301Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 13 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "9550ea3e-79ee-4c0e-b939-b5cb66cd1ed1" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50864 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.335Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ee8b5984-3fd4-46bc-81d6-484c8e965021" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50870 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.369Z] "DELETE /v1/api-keys/492f26aa-39c8-4a0c-8006-d86e4b923f84 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "c7ee594c-ff0f-4d9a-baba-8a5d7a0aacb9" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50882 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.559Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "61b74cb1-7dc5-4694-a518-8d9fe0116573" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50896 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.597Z] "DELETE /v1/api-keys/22cbc80f-92bb-49e3-8b3d-bb9be9ab6569 HTTP/1.1" 200 - via_upstream - "-" 0 321 21 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "a6371afa-c345-4eab-a281-9381462d0be3" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:50900 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.641Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 -  - "-" 77 0 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "306ff1ad-0256-4ac5-8881-49d3fa9c64ad" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50902 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.676Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "05ca1d5d-be66-45cb-a06d-460b17ebc734" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50916 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.713Z] "DELETE /v1/api-keys/9bfd5dd8-43b6-4ea7-87db-6a800edf72a2 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "360bee90-dca5-47ed-8cdb-3761f48dad04" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50922 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.894Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "9f3d23b9-b1fb-43f8-b842-4bd943fad3b6" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50934 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:47.929Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 13 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "c675e598-e94d-41d6-a78e-0a78df576139" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50950 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:58:48.097Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "36056e99-b102-485f-acfd-5af5286dfe51" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:50964 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T18:58:52.436350Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:58:54.412740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:55.214109Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:58:55.214280Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-18T18:58:54.396Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1725f35a-3cc1-4ccb-bf20-63616925ac9a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:51440 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:58:54.833Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 -  - "-" 83 0 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "f970fb96-4cc5-4ec5-a925-ecbd8aa791b3" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.36:443 10.133.0.11:51442 - llm.e2e-external-model.0
[2026-09-18T18:58:54.868Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 6 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "a6ec0940-4784-4776-a656-deac7913adc7" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.36:443 10.133.0.11:51448 - llm.e2e-external-model.0
[2026-09-18T18:58:54.897Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 316 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "143c7808-c0e8-43e7-9084-19094be89f5f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:34500 10.132.0.36:443 10.133.0.11:51454 - llm.e2e-external-model.1
2026-09-18T18:58:56.246186Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T18:58:56.145Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 21 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "7e0a31a0-e975-4c18-bbb9-deae49371111" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:51460 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:58:56.180Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "59dddd23-cad1-4b60-a880-6f715051f34b" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" - - 10.132.0.36:443 10.133.0.11:51468 - -
[2026-09-18T18:58:56.187Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 19 - "52.71.36.72,10.133.0.11" "-" "893d2ab0-b9a9-4ad1-9bc6-58ba5dad194f" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:51476 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:58:56.230Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "118501a9-b802-4b2d-af24-c3bbb3e918b1" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:51488 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T18:59:00.365752Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-18T18:59:01.275Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 12 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "a7892195-a75a-4f15-81bb-f7f9345cb7a9" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:50984 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:59:08.074Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 7 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1390bacf-6d18-4602-b0d0-71a64ac634ae" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" - - 10.132.0.36:443 10.133.0.11:50988 - -
2026-09-18T18:59:10.143522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:59:12.124674Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T18:59:12.109Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "98298b19-b6f2-4a0f-b335-f2123a87bc83" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:41232 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:59:12.152Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "28f45a66-3400-4466-82c4-32b7deefa675" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:41238 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-18T18:59:12.277028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:59:12.277167Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-18T18:59:12.485050Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T18:59:12.485278Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=24
2026-09-18T18:59:12.966693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T18:59:12.966879Z	error	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2")	thread=25
[2026-09-18T18:59:12.205Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 71 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "914871b2-46db-4415-a53f-761529702f92" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:42870 10.132.0.36:443 10.133.0.11:41244 - llm.e2e-external-model.1
[2026-09-18T18:59:12.300Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 184 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1ff0050f-aaa0-442d-8c6b-c72c94aec120" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:42870 10.132.0.36:443 10.133.0.11:41254 - llm.e2e-external-model.2
[2026-09-18T18:59:12.515Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 451 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "2e9fc546-f175-4e49-aea7-e2fcb270ad07" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.36:42878 10.132.0.36:443 10.133.0.11:41266 - llm.e2e-external-model.2
2026-09-18T18:59:14.182238Z	info	ads	ADS: "" 4 terminated
2026-09-18T18:59:18.752580Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T18:59:18.736Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "b232a7a2-952c-4999-a613-c03d009209ca" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:41272 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T18:59:18.774Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 20 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "8a3b10c9-b6df-485b-8a53-d79922410133" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:41276 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:59:18.813Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 20 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "7a6eb5a9-98e0-4ca4-9978-26dfda305e0a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:41282 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:59:18.852Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3e27daf0-1de8-46fe-977d-d7cc59b807b6" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:41288 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T18:59:18.889Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 19 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "413878b1-9262-4674-894d-80f83fe5fa60" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:41296 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T18:59:22.743746Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T18:59:39.159254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T18:59:38.778Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 5 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "26d25c11-42fc-49d7-8e95-6debceefae8a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" - - 10.132.0.36:443 10.133.0.11:34890 - -
[2026-09-18T18:59:38.953Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3076f789-366e-45fb-8e63-303e9c743d90" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" - - 10.132.0.36:443 10.133.0.11:34898 - -
[2026-09-18T18:59:39.107Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "598dba9b-73c6-4d62-88a9-28efd0041580" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" - - 10.132.0.36:443 10.133.0.11:34910 - -
[2026-09-18T18:59:39.152Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 6 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "075213a7-4018-43e8-b74a-2882929b0ddc" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49756 10.132.0.36:443 10.133.0.11:34916 - odh-ai-gateway-infra.maas-api-route.4
2026-09-18T18:59:39.342675Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T18:59:39.323Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "6510edbf-fd84-4ba1-96c9-330445dba0bb" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:49740 10.132.0.36:443 10.133.0.11:34932 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:02:13.075408Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:02:24.967992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:03:40.600044Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:03:59.881160Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:17:44.993381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:17:44.975Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "18339af1-05df-4901-a1af-6dc2edb8436c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54494 10.132.0.36:443 10.133.0.11:56310 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:17:45.028Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 317 33 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1b389d6a-159b-4f62-b461-499a97da0c76" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:56326 - llm.facebook-opt-125m-simulated-kserve-route.2
[2026-09-18T19:17:45.086Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 324 19 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "a690a6d8-50d2-450a-98cb-e6073dd60a91" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:56338 - llm.facebook-opt-125m-simulated-kserve-route.2
2026-09-18T19:21:56.824557Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:21:56.794Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 29 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "16bedb50-a399-47c3-bf31-9d3904abb77c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:44046 10.132.0.36:443 10.133.0.11:49000 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:21:58.685530Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:21:58.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 20 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3dcdae9b-6f5c-4af0-8751-35a9bfdf25c2" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:44046 10.132.0.36:443 10.133.0.11:49002 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:22:00.006064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:23:23.550455Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:23:24.232719Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:23:24.216Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "fa95bd3c-6f13-4cf8-8126-61b56e13e8de" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:45702 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:23:37.524019Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:23:37.506Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "99cd5a01-89fa-40b2-b663-936026fc50ff" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41766 10.132.0.36:443 10.133.0.11:58640 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:23:43.067Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 31 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "038a13bb-0164-41dd-b19f-958d7b8c613c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:44480 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:23:43.124Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 -  - "-" 66 0 8 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "e930ab40-9077-4d20-aa72-3218147f4eb5" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44486 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:23:43.192Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 19 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ffcff9f2-dee7-9a69-ac8b-3203ba741620" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:44490 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:23:43.231Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 -  - "-" 66 0 7 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "27eccef8-57c4-4585-98ca-3e1469e24ba4" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44502 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:23:43.263Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 -  - "-" 66 0 5 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "824e7312-2dce-4c45-8603-ed4291b31f2c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44506 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:23:43.292Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "e85cc9e3-1eaf-4fec-8aeb-86eeaeeba960" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:44510 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:02.959908Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:24:06.336536Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:06.315Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 21 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "c227ec9d-b45c-4190-b938-b980314f9a2c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:40638 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:06.358Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 32 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "86c9dc59-9e21-4725-992e-20f209c39c46" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59828 10.132.0.36:443 10.133.0.11:40654 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:06.512Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "6b41d204-be6d-44a1-be3b-2442a9697811" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59832 10.132.0.36:443 10.133.0.11:40670 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:06.653Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3f90e680-188f-4bc1-8c35-289f2464a67b" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59832 10.132.0.36:443 10.133.0.11:40682 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:06.790Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "5a9b4425-ef6e-41f0-af1b-42490a735c4f" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59828 10.132.0.36:443 10.133.0.11:40698 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:06.927Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "925eac26-6757-486f-acd5-8c4b08efe87e" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59828 10.132.0.36:443 10.133.0.11:40708 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:07.068Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "03f91d83-df4c-4546-8928-1dab46ab3617" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:40716 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:10.911925Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:24:15.757736Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T19:24:15.933935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:15.739Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "47408710-5a50-4b48-aa4d-2ebf92b73bac" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41766 10.132.0.36:443 10.133.0.11:37588 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:15.780Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "056dc4d9-4aa1-45c2-9b31-1574344723e9" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59828 10.132.0.36:443 10.133.0.11:37594 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:15.817Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "65edabf4-bbee-44b3-be5e-b77c967e1449" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59832 10.132.0.36:443 10.133.0.11:37600 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:15.852Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "cbd5961f-cb8b-42e2-8cc2-f40058b42d75" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:37610 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:15.885Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "df4ab92c-6442-4e85-b96d-873c81e05f08" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:37620 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:15.919Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "6e89ff8c-3b8c-4442-82b4-fa622ce3ff64" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59832 10.132.0.36:443 10.133.0.11:37624 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6
2026-09-18T19:24:16.695206Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:16.678Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "44c95514-3ff2-43a1-a3da-5f3582627b80" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:37638 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:16.713Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "328367b3-bd45-401f-b97b-3a11714a77f0" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:37654 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:17.697Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "f31d9c10-889b-4df4-9a07-35418d1dd268" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:37658 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:18.415Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "452ca6ff-d184-44fb-9cc1-daae1da1b007" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32994 10.132.0.36:443 10.133.0.11:37670 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:19.466146Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-18T19:24:19.541Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "36fce61c-dd9a-44cb-94a4-d4a5c77b7d10" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:37674 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:22.865Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 10 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "c52f180f-51e4-4eb1-9e87-851922577f55" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44460 - llm.facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:24:27.961Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 76 107 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ba798282-f572-40ce-831b-2e81685b6e93" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44462 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:28.839523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:28.822Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "6d917358-536c-46f2-b0a3-d6011770d87a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:44474 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:29.197Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "7c0708f4-1536-47b8-827f-102d62867f40" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:44476 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:35.339978Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:24:37.298784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:37.283Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 14 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "0f1e1b79-b59b-4c36-a0e2-8d5d27aa29e3" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:53284 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:37.318Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1e3878ad-9a9d-4a1a-a21d-13414a2a416a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:32982 10.132.0.36:443 10.133.0.11:53296 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:38.629962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:24:38.614Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "84cb4466-18c8-4c56-bc7c-b953884c52fb" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:34754 10.132.0.36:443 10.133.0.11:53308 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:24:38.998Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 32 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "b112e586-0518-43c3-a3c5-ae88ed7b600a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:53314 - llm.facebook-opt-125m-simulated-kserve-route.0
2026-09-18T19:24:42.268224Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:25:45.062277Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:25:45.045Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 17 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "d4a8d004-c208-4b85-89b3-b87d3310b60d" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54786 10.132.0.36:443 10.133.0.11:37314 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:25:45.089Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 -  - "-" 73 49 21 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "0e551a93-f080-41cc-8571-24770944fb79" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:37322 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-18T19:26:06.055460Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-18T19:26:06.729Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 33 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "d4406764-7a74-418d-a3f5-8085a53a5a9e" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.45:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:41194 10.132.0.36:443 10.133.0.11:45280 - llm.e2e-trlp-test-simulated-kserve-route.0
2026-09-18T19:26:07.358876Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:26:07.345Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "1a14e39a-3a47-4956-b611-aa80926fd044" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54786 10.132.0.36:443 10.133.0.11:45292 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:26:10.077675Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:26:15.253129Z	info	xdsproxy	connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012	id=2
2026-09-18T19:26:15.295020Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:26:15.973257Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:26:15.957Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "b9669697-195a-4f42-b77d-9a05a523a2f0" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:52226 10.132.0.36:443 10.133.0.11:44812 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:26:16.111104Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:26:16.100Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3b6d25ac-af4f-4e57-8885-b4d5954a465a" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:52226 10.132.0.36:443 10.133.0.11:44816 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:26:18.502208Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:26:22.968943Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:26:32.983900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:26:37.903979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:07.809015Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T19:27:07.845783Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:27:07.784Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 24 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "38329ec4-5406-4d28-8cf3-751883657d9c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:52226 10.132.0.36:443 10.133.0.11:34258 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:27:07.833Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 12 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "2678e0b1-8ab5-482b-a213-47a675198f14" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41736 10.132.0.36:443 10.133.0.11:34268 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:27:11.970498Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:18.170450Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:20.015861Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
2026-09-18T19:27:20.055409Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:27:19.997Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "b670b38e-d110-4deb-a80d-439775dbe605" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41736 10.132.0.36:443 10.133.0.11:56256 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:27:20.044Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ede7f832-26ae-42ec-89c2-dab1b3f52e38" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41736 10.132.0.36:443 10.133.0.11:56270 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:27:22.350166Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:31.565891Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:39.142007Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
2026-09-18T19:27:39.183075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:27:39.125Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 16 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "7c441e79-9298-489f-8f0f-43c294b3ef6e" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:52226 10.132.0.36:443 10.133.0.11:43268 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:27:39.172Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "58a0b97a-a2a8-4f5e-b5f3-6908c42d272b" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41736 10.132.0.36:443 10.133.0.11:43270 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:27:39.328136Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=24
[2026-09-18T19:27:39.204Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 19 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "00e31e92-db97-4767-928f-b290013e94d3" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:59828 10.132.0.36:443 10.133.0.11:43284 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:27:39.247Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "3845a344-c081-4cc2-895b-f4b0528a623d" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43290 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:27:39.284Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 -  - "-" 76 18 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "05e2d9c7-1205-42f6-9fae-b94ef56ddd5e" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:43292 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-09-18T19:27:39.318Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ed8080ec-313e-4aa8-bdb7-173814381bea" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:41736 10.132.0.36:443 10.133.0.11:43300 - odh-ai-gateway-infra.maas-api-route.3
2026-09-18T19:27:41.795655Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
[2026-09-18T19:27:47.155Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 -  - "-" 61 39 23 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "858c8b22-777c-4fa6-8f0f-842722b75807" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:40416 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-18T19:27:49.780200Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:27:53.357947Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:27:53.333Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 24 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "7ae76d13-a208-46a6-b638-21d4b1c87673" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.132.0.92:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:54648 10.132.0.36:443 10.133.0.11:33928 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:27:53.381Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 46 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "aab35566-e3c1-4e63-aa3b-ad36f777bc22" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:50992 10.132.0.36:443 10.133.0.11:33934 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-18T19:27:53.550Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "731b0638-c911-4d46-949a-2c92e7ad5a2c" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:51004 10.132.0.36:443 10.133.0.11:33946 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-18T19:27:53.692Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "84298cfc-0c93-43d4-8876-fe2e63d2e9ea" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:51004 10.132.0.36:443 10.133.0.11:33962 - llm.e2e-embedding-simulated-kserve-route.6
[2026-09-18T19:27:53.830Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 -  - "-" 61 18 15 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "4c3a2f91-f147-4900-8b9c-aefb1964f167" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.36:443 10.133.0.11:33978 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-18T19:27:56.961188Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:28:00.782225Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8
2026-09-18T19:28:07.565048Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens	thread=25
[2026-09-18T19:28:07.542Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 22 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "94c37508-1a65-4301-89f0-3b5d52a96bd5" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.134.0.86:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.36:44440 10.132.0.36:443 10.133.0.11:36222 - odh-ai-gateway-infra.maas-api-route.3
[2026-09-18T19:28:07.588Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 24 - "52.71.36.72,10.133.0.11" "python-requests/2.32.5" "ed568b7e-d014-4706-83d1-adf123d25a8f" "maas.apps.882edaa7-dd1e-4abb-ae60-f83a6fc89fb9.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.36:51004 10.132.0.36:443 10.133.0.11:36232 - llm.e2e-embedding-simulated-kserve-route.6
2026-09-18T19:28:10.278176Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317	Wasm remote code fetch is unstable and may cause a crash	thread=8