2026-07-07T18:17:01.222566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.222693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.222809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.222880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.224238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.224263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.224313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:01.224323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.224335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:01.224342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.233840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.234001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.234128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.234214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.235835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.235862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.235946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:01.235957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.235974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:01.235981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:01.237108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:01.237177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:01.237193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:17:01.210Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 13 - "10.132.0.60" "Go-http-client/1.1" "d7ac0e56-0f75-4946-91bb-093a2c7f6ff5" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:50602 10.132.0.51:443 10.132.0.60:40896 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:17:01.210Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 25 - "10.132.0.60" "Go-http-client/1.1" "f0a7a443-6cab-4206-b643-f9fc3c8b01fd" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.25:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:36428 10.132.0.51:443 10.132.0.60:42764 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.premium-simulated-simulated-premium-kserve-route.6 [2026-07-07T18:17:01.201Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 942 35 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "6479e138-e7ed-4e0f-a133-ad45287d0bdf" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:57442 - opendatahub.maas-api-route.1 2026-07-07T18:17:13.253053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.253100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.265000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.265156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.265427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.269580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:13.269663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:13.269680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:17:13.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 92 334 18 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "3861b31e-1449-439d-a032-db398b06ad7d" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:39636 - opendatahub.maas-api-route.1 2026-07-07T18:17:17.299701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.299756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.305748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.305942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.308860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.308887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.308900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.308943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.318032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.318102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.318164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.318227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.318286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.318334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.319652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.319714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:17.319724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.331859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.331954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:17.331967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:17.333878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:17.333963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:17.333976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:17:17.307Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.132.0.60" "Go-http-client/1.1" "9e596450-810e-4276-b6f4-7e53c5616267" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:52858 10.132.0.51:443 10.132.0.60:42764 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:17:17.307Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 24 - "10.132.0.60" "Go-http-client/1.1" "c119fa94-52d1-4de0-b8c9-8b29935806ae" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.63:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55126 10.132.0.51:443 10.132.0.60:40896 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-07T18:17:17.298Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 827 35 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "187f8c58-5757-40d6-a801-878a5349e0c3" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:39642 - opendatahub.maas-api-route.1 2026-07-07T18:17:29.875620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.875677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.887575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.887746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.893211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.893263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.893353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.893399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.902340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.902403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.910192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.910235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.910347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.910366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.910478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.910483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.912181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.912291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:29.912310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.913317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.913398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:29.913411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.917243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.917371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.917493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.920762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.920835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:29.920846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:29.923167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:29.923265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:29.923284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:17:29.890Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 21 - "10.132.0.60" "Go-http-client/1.1" "7155c3b1-a131-4abd-a313-c2f2f91bde18" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:50602 10.132.0.51:443 10.132.0.60:40896 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:17:29.890Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 22 - "10.132.0.60" "Go-http-client/1.1" "da7136fb-b47e-4f72-9232-a4b229a813a3" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:52858 10.132.0.51:443 10.132.0.60:42764 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:17:29.900Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 20 - "10.132.0.60" "Go-http-client/1.1" "c6e5c327-5ad8-47bf-9ff9-8e9a13784fa7" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.63:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:56778 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-07T18:17:29.874Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1372 49 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "0ea3feb1-ef52-4614-b561-3ffb66c9de60" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:56064 - opendatahub.maas-api-route.1 2026-07-07T18:17:39.504027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.504077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.515411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.515566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.518925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.518969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.518981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.532311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.532445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.532570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.532642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.534154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.534180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.534234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:39.534244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.534264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:39.534271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.535350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:39.535411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:39.535422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:17:39.517Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 17 - "10.132.0.60" "Go-http-client/1.1" "f32825b5-f18a-4cda-82bf-ab57b1ce85e1" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:33164 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:17:39.502Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 484 32 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "c38b6658-8d1e-4150-88b4-d1bd33cdbf56" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:40552 - opendatahub.maas-api-route.1 2026-07-07T18:17:50.978308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.978361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.987064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.987217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.987482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.991044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:17:50.991111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:17:50.991121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:17:50.976Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "88182665-1204-4129-8c8d-4f88d4c41ce8" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:42762 - opendatahub.maas-api-route.1 2026-07-07T18:17:55.025636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.025688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.031617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.031766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.033443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.033509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:55.033519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:17:55.024Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 9 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "ffe647e4-8006-47f4-96b4-e763ee2a455e" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:42764 - opendatahub.maas-api-route.1 2026-07-07T18:17:55.655953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.655997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.667141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.667289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.667548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.670624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:55.670693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:55.670703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:17:55.654Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 16 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "ba87961f-745f-426a-801c-bf1764491638" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:42778 - opendatahub.maas-api-route.1 2026-07-07T18:17:59.704718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.704767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.710596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.710732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.713430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.713466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.721788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.721953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.722063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.723235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.723294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:59.723304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.724250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:17:59.724316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:17:59.724327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:00.095261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.095313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.103757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.103921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.104172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.107046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:00.107110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:00.107121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:17:59.711Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.132.0.60" "Go-http-client/1.1" "c68161ec-0dc0-4120-81b2-3b5b5f8a0149" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:33164 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:17:59.703Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 597 21 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "e00f181a-70ae-43f3-9a88-43bb1ef50892" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:54960 - opendatahub.maas-api-route.1 [2026-07-07T18:18:00.093Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 318 13 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "9ea11f21-7e7a-44f8-a148-aa791740795c" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:54968 - opendatahub.maas-api-route.1 2026-07-07T18:18:04.140685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:04.140746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:04.146546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:04.146712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:04.149669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.149710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.158067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.158211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.158329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.159631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.159697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:18:04.159708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.160735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:04.160813Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:04.160829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:18:04.147Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.132.0.60" "Go-http-client/1.1" "606d80af-579b-428d-afe4-9be75943c036" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:33164 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:18:04.139Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 597 21 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "e8b93398-2baf-4f4d-807f-eb23ce733d75" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:54976 - opendatahub.maas-api-route.1 2026-07-07T18:18:04.917488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.917543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.926228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.926406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.926696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.929799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:04.929881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:18:04.929898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:18:04.916Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 13 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "1fd2daf9-dde6-45cb-bb56-84e8f6d834aa" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:54982 - opendatahub.maas-api-route.1 2026-07-07T18:18:08.970114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.970166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.976356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.976504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.979427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.979465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.990006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.990136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.990253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.991676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.991746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:18:08.991754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.993020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:08.993099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:18:08.993111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:18:08.977Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 14 - "10.132.0.60" "Go-http-client/1.1" "ebdbef53-67c7-430d-95a7-b440871f48d4" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:33164 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:18:08.968Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 481 25 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "686f9ed1-36b5-41bd-a317-fdf2cea257f5" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:40154 - opendatahub.maas-api-route.1 2026-07-07T18:18:14.225453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.225502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.236481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.236652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.236965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.240220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:18:14.240284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:18:14.240295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:18:14.224Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 327 16 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "f98d31f5-92d4-4053-ba81-454fb60743a5" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:40170 - opendatahub.maas-api-route.1 2026-07-07T18:18:22.508516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:22.508575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:22.516067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:22.516227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:22.518019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:22.518079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:22.518089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:18:22.507Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 11 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "5910e52c-abe9-4daf-82d0-e4ad573f10c0" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:50156 - opendatahub.maas-api-route.1 2026-07-07T18:18:31.591081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:31.591149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:31.609471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:31.609679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:31.611665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:31.611727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:31.611734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:18:31.588Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 22 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "44efca9b-30b5-4354-90d8-5a5fc47d010f" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:58846 - opendatahub.maas-api-route.1 2026-07-07T18:18:40.841484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:40.841536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:40.852583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:40.852748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:40.854501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:40.854577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:40.854592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:18:40.840Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 14 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "1ec95983-9b4a-449b-9647-a0daab601d5a" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:57756 - opendatahub.maas-api-route.1 2026-07-07T18:18:50.285702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:50.285843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:50.294428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:50.294568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:50.296224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:18:50.296284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:18:50.296293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:18:50.283Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 12 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "617d6bc0-f7ee-46f8-9b36-348e43014f5d" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:48532 - opendatahub.maas-api-route.1 2026-07-07T18:19:02.636642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.636689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.647321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.647451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.647688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.650728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:02.650787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:02.650797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:19:02.635Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 15 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "6bb2c3a1-4cba-4230-917b-c0a3bab744ea" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:36004 - opendatahub.maas-api-route.1 2026-07-07T18:19:06.683213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.683264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.690257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.690415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.693533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.693577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.702587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.702727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.702856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.704220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.704282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:06.704292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.705279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:06.705334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:06.705345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:19:06.691Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.132.0.60" "Go-http-client/1.1" "ecc7eb14-d305-49a0-be39-e918dea8c32d" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:52858 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:19:06.681Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 478 23 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "68abd6f8-1ef4-43b4-bff3-a2d5cf2398fa" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:36010 - opendatahub.maas-api-route.1 2026-07-07T18:19:19.080161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.080210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.091438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.091599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.091873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.097323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.097388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:19.097398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.125712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.125757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.133504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.133641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.133878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.136714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:19.136774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:19.136785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:19:19.078Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 18 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "65a2a025-d23b-4424-8824-104b1c9fd7de" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:36734 - opendatahub.maas-api-route.1 [2026-07-07T18:19:19.124Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 12 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "d84b8dc1-e3cc-4c97-94c9-e918eee57f2a" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:36750 - opendatahub.maas-api-route.1 2026-07-07T18:19:23.166486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.166537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.172062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.172197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.175117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.175155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.182853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.183018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.183128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.184335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.184395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:23.184405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.185426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.185482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:23.185493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.211393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.211433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.217243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.217374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.220195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.220234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.227628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.227746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.227849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.229004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.229073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:23.229084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:23.229959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:23.230015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:23.230026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:19:23.173Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.132.0.60" "Go-http-client/1.1" "c03e5e92-e721-4f0d-98a5-37860736727d" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:52858 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:19:23.165Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 475 20 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "6d6edfd9-8fe6-4206-8484-4cb68620c1ea" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:36766 - opendatahub.maas-api-route.1 [2026-07-07T18:19:23.218Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.132.0.60" "Go-http-client/1.1" "ce2b623a-b87a-4139-ba1d-9ffb546240a9" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.63:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:56778 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-07T18:19:23.210Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 352 19 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "4662e88a-4b5c-4e34-8f85-0a8fa9c49108" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:36774 - opendatahub.maas-api-route.1 2026-07-07T18:19:33.773428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.773482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.786974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.787137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.792112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.792153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.800444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.800484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.801293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.801339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.807817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.807989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.808141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.810050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.810174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:33.810216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.816149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.816274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.816394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.816486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.816611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.816729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.818356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.818429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:33.818445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:33.819630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.819693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:33.819704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.821749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:33.821811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:33.821823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:19:33.789Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 20 - "10.132.0.60" "Go-http-client/1.1" "fff12dc5-45c8-42cf-bda0-e1ea98baf976" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.65:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:33164 10.132.0.51:443 10.132.0.60:50902 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:19:33.798Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 19 - "10.132.0.60" "Go-http-client/1.1" "f3d25e7f-fb0e-44eb-9476-4d922476808b" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.63:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:56778 10.132.0.51:443 10.132.0.60:37844 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-07T18:19:33.799Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 20 - "10.132.0.60" "Go-http-client/1.1" "dd8eb057-f77b-4e8d-945f-3ff571f666e7" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:39758 10.132.0.51:443 10.132.0.60:37842 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:19:33.772Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1382 49 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "4c621f17-64d9-4914-95bf-c9f4c3d3354d" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:51354 - opendatahub.maas-api-route.1 2026-07-07T18:19:46.547397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.547454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.558747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.558940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.563576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.563639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.578940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.579094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.579237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.580708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.580788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:46.580805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.582315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.582379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:19:46.582391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:46.607334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.607388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.615957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.616129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.619274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.619332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.632743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.632926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.633082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.635399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.635480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:46.635496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.636570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:19:46.636637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:19:46.636650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:19:46.561Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 19 - "10.132.0.60" "Go-http-client/1.1" "11511fa5-9ad5-4731-b7ff-87ac762bfab3" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.64:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:39758 10.132.0.51:443 10.132.0.60:37842 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-07T18:19:46.546Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 477 36 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "2288048e-0f26-4487-a9d3-b1597d1a53d4" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:52304 - opendatahub.maas-api-route.1 [2026-07-07T18:19:46.617Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 18 - "10.132.0.60" "Go-http-client/1.1" "3dacfe8e-d32d-43d7-9e47-45dcd7871e3b" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.63:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:55126 10.132.0.51:443 10.132.0.60:37842 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-07T18:19:46.605Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 354 30 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "c3d0bf2e-6fa0-4776-aa4b-b9888857e46c" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:52306 - opendatahub.maas-api-route.1 2026-07-07T18:19:51.718735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:51.718792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:51.720086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:19:51.720128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:19:51.717Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "02707de9-4d1f-4660-8c15-c366bc73f704" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.51:443 10.133.0.10:49784 - opendatahub.maas-api-route.1 2026-07-07T18:20:03.115974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.116024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.127560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.127713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.128016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.131320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.131390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:20:03.131400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.160219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.160272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.169421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.169578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.169953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.169997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.172025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.172057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.172363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.176565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.176719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.176941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.177545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.202764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.202811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.211946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.212091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.212443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.212483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.213277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.213303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.239792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.239842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.248729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.248864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.249238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.249275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.250019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.250045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:03.278751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.278803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.284315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.284464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.287393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.287435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.295692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.295821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.295969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.298980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.299060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:20:03.299072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.300107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-07T18:20:03.300172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-07T18:20:03.300183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-07T18:20:03.114Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 17 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "e3e0598d-7dcf-4b69-82ca-7f4af92bd70a" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:58074 - opendatahub.maas-api-route.1 [2026-07-07T18:20:03.158Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 19 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "d092d86e-4b5b-4709-b7c9-5cbca5d5fbc4" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.134.0.24:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:41498 10.132.0.51:443 10.133.0.10:58082 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-07T18:20:03.200Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 12 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "4dcdcf02-8344-4ee2-97ef-7afffe86fe8a" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.134.0.24:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:43600 10.132.0.51:443 10.133.0.10:58084 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-07T18:20:03.237Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 12 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "15fb62a2-1977-4e82-8d43-86d4b8ff6e12" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.134.0.24:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:41498 10.132.0.51:443 10.133.0.10:58100 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-07T18:20:03.285Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 13 - "10.132.0.60" "Go-http-client/1.1" "de1cd219-5e90-470b-babf-91aac895e2c9" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.24:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.51:41510 10.132.0.51:443 10.132.0.60:37842 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 [2026-07-07T18:20:03.277Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 554 22 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "1c1886e2-9e98-484d-8a54-bca01857d3bb" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:44966 10.132.0.51:443 10.133.0.10:58116 - opendatahub.maas-api-route.1 2026-07-07T18:20:08.412749Z info ads ADS: new connection for node:4 2026-07-07T18:20:08.416278Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-07-07T18:20:08.416339Z info cache read certificate from file resource=file-root:system 2026-07-07T18:20:13.096982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.097029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.111594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.111799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.112140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.115680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.115753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:20:13.115764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:20:13.095Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 20 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "8cb2ccbc-72f6-43f8-995c-c01b389bb03c" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "10.132.0.60:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.51:49970 10.132.0.51:443 10.133.0.10:49036 - opendatahub.maas-api-route.1 2026-07-07T18:20:13.494309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.494356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.523249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.523291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.551848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.551895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.553118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.553155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.580773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.580816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.589842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.590014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.590339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.590375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.592111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.592141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.592423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.604564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-07T18:20:13.604728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-07T18:20:13.604740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-07T18:20:13.492Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 31 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "acbadd52-d4a5-4620-93d5-bc575566f006" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.51:443 10.133.0.10:49048 - llm.maas-e2e-external-model.0 [2026-07-07T18:20:13.549Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 3 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "4bbc08ac-f311-4b19-844b-0bb81c9e9a91" "maas.apps.65d66aac-e59f-4b70-bf02-67bf82c58916.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.51:443 10.133.0.10:49062 - llm.maas-e2e-external-model.0 [2026-07-07T18:20:13.578Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 26 - "52.71.36.72,10.133.0.10" "python-requests/2.32.5" "9c2309c1-1eff-4ce1-832b-dada6e44ebb3" "httpbin.org" "3.219.145.192:443" outbound|443||httpbin.org 10.132.0.51:34482 10.132.0.51:443 10.133.0.10:49068 - llm.maas-e2e-external-model.0 2026-07-07T18:20:27.389328Z info ads ADS: "" 4 terminated