2026-06-09T13:49:49.191394Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:49:49.191522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:49:49.191716Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:49:49.192030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:49:49.314919Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.314961Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.321420Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.321534Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.321806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.321838Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.322189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:49:49.322213Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:49:49.046Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 12 - "100.64.0.3" "python-requests/2.32.5" "37641e2e-9d59-4460-b11f-46e210afa2f0" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:56940 10.133.0.35:443 100.64.0.3:10006 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-06-09T13:49:49.179Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 12 - "100.64.0.2" "python-requests/2.32.5" "55f65281-a33e-4970-8d8d-6feb8bc99e69" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:56948 10.133.0.35:443 100.64.0.2:19726 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-06-09T13:49:49.313Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 8 - "100.64.0.4" "python-requests/2.32.5" "899b1d3f-c488-421b-85e6-3d934724c8d3" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:56940 10.133.0.35:443 100.64.0.4:13378 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:14.421694Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:14.421740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:14.436729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:14.436866Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:14.437051Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:14.420Z] "POST /maas-api/v1/api-keys HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 93 0 16 - "100.64.0.3" "python-requests/2.32.5" "9d69f135-5fd8-4eb6-9c7a-e948d0c4be8a" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.35:443 100.64.0.3:61466 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-06-09T13:50:23.091984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.092024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.099344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.099483Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.099761Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.099792Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.100933Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.100957Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:23.101139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:23.090Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.2" "python-requests/2.32.5" "f02d2a44-9eef-4bb0-982c-bff0912df488" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:43742 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:25.129447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.129493Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.129506Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.136647Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.136782Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137038Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137083Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137499Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137518Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137612Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137731Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:25.137799Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:25.127Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "5534cd49-82a9-42f7-9235-b52740b4cb68" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:15868 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:27.163450Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.163494Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.163508Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.170766Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.170901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171006Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171234Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171643Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171678Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171847Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:27.171863Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:27.161Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.4" "python-requests/2.32.5" "2d6a935b-7a31-48b5-a548-cbe645988501" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:24890 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:29.202192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.202237Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.202254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.210649Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.210778Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.210876Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211489Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211521Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211709Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:29.211730Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:29.200Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 11 - "100.64.0.2" "python-requests/2.32.5" "47674637-8f86-4b6d-8027-6a070953c87e" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:19044 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:31.239530Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.239609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.239623Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.246424Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.246575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.246677Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.246878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.246905Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.247300Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.247322Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.247333Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.247502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:31.247519Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:31.237Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "94b3580b-7590-47c5-b741-2dc5f271ef23" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:24684 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:33.277074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.277119Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.277132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285082Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285215Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285320Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285520Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285569Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.285998Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.286009Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.286172Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:33.286190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:33.275Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.3" "python-requests/2.32.5" "5b5d98f4-d834-43fb-9ba0-cbe733ad604f" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:50454 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:35.311482Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.311529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.311542Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.318510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.318666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.318772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.318973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319000Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319404Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319431Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319442Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319634Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:35.319652Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:35.309Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.2" "python-requests/2.32.5" "fe506afb-280d-4560-97a5-82d8374de242" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:60182 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:37.344512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.344586Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.344606Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.351415Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.351574Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.351822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.351856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.351871Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.352259Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.352283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.352358Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.352475Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:37.352571Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:37.342Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "1065ca0c-68c0-46e1-aaef-1fc0773cfd9d" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:47994 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:39.380865Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.380911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.380922Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.388197Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.388326Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.388429Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.388644Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.388672Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.389087Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.389115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.389126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.389303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:39.389321Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:39.379Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.2" "python-requests/2.32.5" "02a4517e-e7c6-44a5-8c1e-45fb7f09ad00" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:35556 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:41.413288Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.413333Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.413351Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.420149Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.420282Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.420388Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.420624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.420653Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.421091Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.421114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.421125Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.421303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:41.421320Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:41.411Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "c56fad30-edba-4f61-976b-ffb2bdcd2e53" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:17172 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:43.445529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.445590Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.445603Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.452856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.452987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453225Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453718Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453744Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.453941Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:43.454020Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:43.443Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.4" "python-requests/2.32.5" "5c36263b-75eb-4c3d-ba64-6fd997dff9dc" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:48010 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:45.479264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.479311Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.479324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.486582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.486721Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.486962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.486993Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487008Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487416Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:45.487697Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:45.477Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.2" "python-requests/2.32.5" "3a30ed6f-7af8-4a1b-8117-c1335dac3f5a" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:35562 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:47.517002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.517048Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.517060Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.523735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.523862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524101Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524131Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524146Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524566Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524640Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524749Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:47.524817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:47.515Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "c3e6ede4-18f7-437c-9b56-8620e63aa30c" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:62922 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:49.556047Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.556096Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.556108Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.562753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.562888Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563145Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563159Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563537Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563652Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:49.563834Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:49.554Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "cdb0c1bc-7a56-44a8-9161-e06d8d7f1fd2" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:41606 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:51.588699Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.588748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.588765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.595296Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.595445Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.595740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.595779Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.595801Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.596198Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.596226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.596316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.596442Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:50:51.596527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:50:51.587Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "39e036d6-842d-4359-807f-afbda0cf553e" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:58828 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:53.622792Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.622848Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.622864Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.629995Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630123Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630355Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630384Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630398Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630808Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.630906Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.631014Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:53.631081Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:53.620Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.4" "python-requests/2.32.5" "7f44e86b-b3a5-412c-8b37-455269b7bf78" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:25676 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:55.659717Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.659768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.659780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.666820Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.666950Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667182Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667214Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667723Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667834Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:55.667901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:55.658Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.2" "python-requests/2.32.5" "15a9459d-5b63-4e9d-942c-7979fb631c18" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:37362 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:57.697002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.697053Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.697065Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.703803Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.703930Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704161Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704723Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704834Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:57.704900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:57.695Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "c2d6d7ca-5965-4d76-8744-978609c7fbab" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:31084 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:50:59.729949Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.730007Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.730019Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737119Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737249Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737537Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737931Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.737952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.738043Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.738158Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:50:59.738227Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:50:59.728Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "b085acbc-ad5c-41a6-84b9-8101ff9158c2" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:4496 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:01.769774Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.769822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.769836Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.778668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.778794Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779052Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779066Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779480Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779511Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779634Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:01.779823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:01.768Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 11 - "100.64.0.2" "python-requests/2.32.5" "8570760d-3445-468b-9e58-e44df3aa5880" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:5418 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:03.810409Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.810460Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.810472Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.817607Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.817735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.817977Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818005Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818020Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818398Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818494Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:03.818695Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:03.808Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.2" "python-requests/2.32.5" "54ce1369-1680-470e-865b-31a0700d37aa" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:13144 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:05.842822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.842867Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.842878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.849726Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.849856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850571Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850756Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:05.850822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:51:05.841Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.3" "python-requests/2.32.5" "3eb12c95-d8c2-4417-a168-003e073ad8b0" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:31096 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:07.882989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.883036Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.883048Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.889909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890044Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890309Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890730Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890752Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890828Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.890941Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:07.891008Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:51:07.881Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "0c6cf425-1d27-4357-99aa-f60ba479e29b" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:19114 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:09.917051Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.917102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.917114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.924417Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.924578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.924837Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.924870Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.924884Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.925289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.925309Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.925388Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.925510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:09.925606Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:51:09.915Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.2" "python-requests/2.32.5" "5dec4d18-78e3-4d8a-b831-c9f52b1e9a72" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:13988 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:11.958940Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.958990Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.959001Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.965689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.965818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966059Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966089Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966103Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966610Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966724Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:51:11.966792Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:51:11.957Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 9 - "100.64.0.4" "python-requests/2.32.5" "26d90ce1-5452-4eca-8528-d8504bd150ef" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.4:20266 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:13.994526Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:13.994592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:13.994606Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.001883Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002026Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002259Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002288Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002705Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002800Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002907Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:14.002973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:13.992Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 66 0 10 - "100.64.0.3" "python-requests/2.32.5" "00dbb09c-4a23-4797-ad84-3ee5af22bdd0" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.3:12466 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:16.029238Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.029290Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.029303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.036315Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.036444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.036701Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.036731Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.036745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.037121Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.037140Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.037216Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.037474Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.037574Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052133Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052188Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052350Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052383Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:16.052757Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:16.027Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 25 - "100.64.0.3" "python-requests/2.32.5" "4dba5224-0461-4da9-a398-7e5d50d34854" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49672 10.133.0.35:443 100.64.0.3:18562 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:51:32.597430Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.597479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.621264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.621405Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.621689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.627121Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.627182Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=26
2026-06-09T13:51:32.627193Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.649122Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.649167Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.649181Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.658019Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.658136Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.658383Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.658414Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.658429Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.659585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.659609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.659691Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.659829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.659901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663167Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663330Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663507Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663543Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:32.663926Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:32.596Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 30 - "100.64.0.4" "python-requests/2.32.5" "b31c4125-d16f-4bca-a816-2ea51adbca08" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.134.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.35:57308 10.133.0.35:443 100.64.0.4:61870 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-06-09T13:51:32.647Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 16 - "100.64.0.2" "python-requests/2.32.5" "c828d15d-23ed-4827-9ddf-6b83045d35eb" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:35070 10.133.0.35:443 100.64.0.2:17108 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.premium-simulated-simulated-premium-kserve-route.0
2026-06-09T13:51:57.537438Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.537482Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.544269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.544398Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.544666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.544698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.545735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.545759Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.545973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.547608Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.547734Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.547895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:51:57.548221Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:51:57.535Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 12 - "100.64.0.2" "python-requests/2.32.5" "84179943-018f-4ae8-9697-b1ef9aab3cbd" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49672 10.133.0.35:443 100.64.0.2:43054 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:52:14.103308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.103351Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.103365Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.110726Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.110853Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.111096Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.111126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.111140Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.112189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.112209Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.112284Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.112422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.112492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114212Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114370Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114404Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:14.114748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:52:14.101Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 13 - "100.64.0.4" "python-requests/2.32.5" "710ea6a5-e53a-4c06-8949-f7c269e79643" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49672 10.133.0.35:443 100.64.0.4:61724 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:52:30.996975Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:30.997033Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.003921Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.004069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.004311Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.004351Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.005272Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.005299Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.005652Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.008069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.008215Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.008394Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:52:31.008739Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:52:30.995Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 13 - "100.64.0.3" "python-requests/2.32.5" "232dc8eb-4854-46d3-8c5a-ec5553f773a6" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49666 10.133.0.35:443 100.64.0.3:53818 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:52:47.982597Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:47.982642Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:47.987829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:47.987862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:52:47.980Z] "POST /v1/completions HTTP/1.1" 403 -  - "-" 66 32 7 - "100.64.0.3" "python-requests/2.32.5" "c2255072-d799-4b42-9543-eb2296aadf3e" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.35:49672 10.133.0.35:443 100.64.0.3:33538 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:52:56.619900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:56.619944Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:56.621233Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:52:56.621264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:52:56.618Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 -  - "-" 66 0 2 - "100.64.0.2" "python-requests/2.32.5" "a1fe4bb3-fd57-4aa0-a0c1-86fa38e96f77" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.35:443 100.64.0.2:5866 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-06-09T13:53:04.902576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:53:04.902630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:53:04.926717Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:53:04.926842Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
2026-06-09T13:53:04.927008Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=25
[2026-06-09T13:53:04.901Z] "POST /maas-api/v1/api-keys HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 69 0 25 - "100.64.0.4" "python-requests/2.32.5" "94b7163e-76a8-4738-a7b2-d8329912c729" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.35:443 100.64.0.4:25506 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-06-09T13:53:52.900246Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:53:52.900292Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:53:52.915672Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:53:52.915784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
2026-06-09T13:53:52.915928Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=26
[2026-06-09T13:53:52.899Z] "POST /maas-api/v1/api-keys HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 79 0 16 - "100.64.0.2" "python-requests/2.32.5" "a993a036-06b3-4314-af9f-eeaaecae1e7c" "maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.35:443 100.64.0.2:34548 maas.apps.22ef9321-c899-4a8d-8d99-68b83c6322a2.prod.konfluxeaas.com opendatahub.maas-api-route.1