[2026-06-02T20:37:52.740Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 18 - "100.64.0.3" "python-requests/2.32.5" "b2449201-c8ac-4c14-a955-b42b65a47832" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.3:64524 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:38:06.817298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.817348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.831656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.831799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.832032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.835741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:06.835803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:06.835814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T20:38:06.815Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 19 - "100.64.0.2" "python-requests/2.32.5" "bb564fd5-0092-4e4d-a07b-ea74fd06334a" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:34804 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:38:14.869755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.869803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.883531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.883655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.893884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.893921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.900546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.900678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.900774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.903453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.903508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:14.903518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.905480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:14.905528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:14.905539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T20:38:14.892Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.133.0.33" "Go-http-client/1.1" "271c0247-96af-4189-8fd3-e2c53ea681b4" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:41334 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T20:38:14.868Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 37 - "100.64.0.4" "python-requests/2.32.5" "1f649a04-0a4f-4ed0-b679-93609e556044" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:11266 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:38:29.139953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.140003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.155882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.156020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.156264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.161312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.161409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:29.161424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:29.184649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.184690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.198200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.198376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.198679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.202119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:29.202188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:38:29.202202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:38:29.138Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 22 - "100.64.0.3" "python-requests/2.32.5" "e480b7c3-0a04-4f22-aa53-7910dbd108a5" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.3:16678 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:38:29.183Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 18 - "100.64.0.4" "python-requests/2.32.5" "913e34a0-22af-47e9-a92a-afabd4bc85c6" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.4:58072 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:38:37.235796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.235852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.239946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.240073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.242529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.242565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.250842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.250967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.251072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.252489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.252545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:37.252556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.253753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.253811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:38:37.253822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.277817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.277851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.281228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.281327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.283430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.283460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.289657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.289774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.289870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.292877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.292928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:37.292939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:37.294885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:37.294934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:38:37.294945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:38:37.241Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.33" "Go-http-client/1.1" "9c26a0e6-7543-4a3e-b223-fd6242243cf1" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:41334 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T20:38:37.234Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 19 - "100.64.0.2" "python-requests/2.32.5" "0a7a1894-dafe-4a39-967b-fa7e332e1629" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.2:10758 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:38:37.282Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.133.0.33" "Go-http-client/1.1" "bf0e5465-94fe-4a19-ab85-3447d21c50fb" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:44994 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T20:38:37.276Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 18 - "100.64.0.3" "python-requests/2.32.5" "9b50fe15-b63a-4143-a306-f1cda0691745" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:35170 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:38:53.921702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:53.921749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:53.938638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:53.938771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:53.941301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.941340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.951953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.952086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.953534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.953593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:53.953604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.955073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.955104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.966068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.966202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.967673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.967739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:53.967757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.969137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.969174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.979600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.979726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.981072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.981133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:38:53.981146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:38:53.982131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:38:53.982199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:38:53.982212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:38:53.940Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 13 - "10.133.0.33" "Go-http-client/1.1" "b869a9f0-9bfb-454f-886e-c6f98db5bf22" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:41334 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T20:38:53.954Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 13 - "10.133.0.33" "Go-http-client/1.1" "ac2703d7-213a-4073-8187-327856dbba7d" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:44994 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T20:38:53.968Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.33" "Go-http-client/1.1" "54eec55b-5041-4e81-9b5d-d1e3272f0f73" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:38:53.920Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 61 - "100.64.0.4" "python-requests/2.32.5" "074fb2a8-9293-4985-a09c-97a32994b1f9" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.4:31530 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:39:12.634704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.634753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.648274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.648421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.651523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.651555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.661415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.661531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.662881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.662937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:12.662948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.663950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.664003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:12.664014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.686610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.686642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.696857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.696956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.698963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.698995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.710768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.710876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.712261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.712313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:12.712325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.713280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:12.713327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:12.713337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T20:39:12.650Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.133.0.33" "Go-http-client/1.1" "ff00585e-932a-4740-9fb6-03a18b3a976b" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:41334 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T20:39:12.633Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 30 - "100.64.0.3" "python-requests/2.32.5" "71dca776-7655-4a8c-942e-fa6acd2cd4ca" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.3:16310 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:39:12.698Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 14 - "10.133.0.33" "Go-http-client/1.1" "30ab6356-fd41-4afa-b4de-0b91cc3c9375" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:44994 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T20:39:12.685Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 27 - "100.64.0.2" "python-requests/2.32.5" "4c0f7436-1667-4668-9c15-960b7b968f5f" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:53134 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:39:21.874155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:21.874205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:21.875699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:21.875732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T20:39:21.872Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.2" "python-requests/2.32.5" "943983a8-0ef6-4864-a25e-21371737eb1e" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.48:443 100.64.0.2:31038 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:39:38.507268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.507317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.521289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.521446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.521659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.526475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.526532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:38.526543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.550732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.550776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.558752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.558913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.559237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.559270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.560361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.560406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.560625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.563434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.563569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.563748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.564196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.584046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.584083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.590627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.590749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.591008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.591037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.591366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.591406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.613903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.613946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.620681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.620791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.621015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.621043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.621336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.621363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.644277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.644312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.647651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.647752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.650322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.650354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.656592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.656703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.656795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.659107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.659159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:38.659170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:38.660729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:38.660785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:39:38.660796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:39:38.505Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 329 20 - "100.64.0.4" "python-requests/2.32.5" "d469eb5b-f959-4deb-b6ac-36c9c8883baa" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:54568 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:39:38.550Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 13 - "100.64.0.4" "python-requests/2.32.5" "39063bdc-c865-4451-9481-925d3b309a8c" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:52206 10.134.0.48:443 100.64.0.4:19668 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T20:39:38.583Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "e487ab39-7a0c-466b-b712-f456a40846a3" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:59004 10.134.0.48:443 100.64.0.3:46790 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T20:39:38.613Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.3" "python-requests/2.32.5" "bf1104e0-cf26-4ffb-a93e-b3a2867623c9" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:52206 10.134.0.48:443 100.64.0.3:14260 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T20:39:38.649Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.33" "Go-http-client/1.1" "16340b65-68a4-4396-bc68-53aa255b3ae3" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:52212 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:39:38.643Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 17 - "100.64.0.2" "python-requests/2.32.5" "74fcce72-766b-42ba-8d0c-b195e06b2b3b" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.2:15496 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:39:47.567097Z info ads ADS: new connection for node:6 2026-06-02T20:39:47.569401Z info cache read certificate from file resource=file-root:system 2026-06-02T20:39:56.534729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.534787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.549874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.550018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.550257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.554536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.554595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:39:56.554605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.913467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.913513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.914575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.914612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:39:56.937721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.937767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.938584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.938616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.964512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.964551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.971587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.971719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.971987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.972036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.973246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.973281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.973544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.974494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:39:56.974626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:39:56.974642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T20:39:56.533Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 21 - "100.64.0.4" "python-requests/2.32.5" "240e3e54-bc90-4f36-a157-3a5d629daa46" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.4:51690 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:39:56.912Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "9e70b66e-be90-4e72-9a5f-3d0011e25c0c" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.48:443 100.64.0.2:12130 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-02T20:39:56.936Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "eff20d71-5d84-49ad-a6ef-636e574f0ac1" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.48:443 100.64.0.3:6584 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-02T20:39:56.963Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 11 - "100.64.0.4" "python-requests/2.32.5" "bbe3449a-43d6-424a-9025-fc5611685ea9" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.48:443 100.64.0.4:33552 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-02T20:40:34.719519Z info ads ADS: "" 6 terminated with stream closed 2026-06-02T20:40:36.611988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.612045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.614950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.615072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.615270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.628207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.628273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:36.628284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.720734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.720786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.748495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.748534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.774118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.774161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.775507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.775540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:36.807466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.807503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.808681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:36.808714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.177710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.177757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.180449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.180569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.180774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.184734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.184789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:37.184800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.397272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.397318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.399957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.400078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.400296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.403843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.403899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:37.403909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.423694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.423732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.427905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.428015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.430526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.430558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.436682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.436818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.436915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.438956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.439010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:37.439020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.440336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.440410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:37.440423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.464732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.464767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.471052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.471191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.471472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.471507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.472690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.472716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.472927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.474474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.474604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.474784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.475134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.560162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.560205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.563012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.563126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.563319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.566761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.566816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:37.566827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:37.585754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.585815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.588552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.588706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.593148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:37.593202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:37.593213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:40:36.610Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 17 - "100.64.0.3" "python-requests/2.32.5" "857583ca-5eca-4ed8-b63c-8b3e9f674f09" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:55482 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:36.719Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 29 - "100.64.0.2" "python-requests/2.32.5" "fd44ade2-4db5-493d-ac1a-5d7bb705ccfe" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.48:443 100.64.0.2:27378 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:36.772Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 2 - "100.64.0.4" "python-requests/2.32.5" "232ee946-2e51-41ff-8598-fba3cec28432" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.48:443 100.64.0.4:43648 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:36.806Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.3" "python-requests/2.32.5" "bfb33cd1-8e1a-43d3-ae25-551ebb2472c4" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.48:443 100.64.0.3:53386 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:37.176Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 8 - "100.64.0.2" "python-requests/2.32.5" "fb8c8ed7-b486-4e86-877e-5c369c8425e9" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:27394 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:37.395Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 312 7 - "100.64.0.4" "python-requests/2.32.5" "0e2de512-e5c0-46ec-a166-ba6a7136862a" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:43652 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:37.429Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.33" "Go-http-client/1.1" "512eaa0f-46b8-48e1-b48f-c9b85ab7bd2f" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:40:37.422Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.3" "python-requests/2.32.5" "16bdbf02-7c13-4b01-af65-83824fad9de7" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.3:53400 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:37.464Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 363 11 - "100.64.0.2" "python-requests/2.32.5" "e0b8090f-f8ea-4397-8b46-89f77ed4d5d3" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:41708 10.134.0.48:443 100.64.0.2:27408 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-02T20:40:37.558Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.4" "python-requests/2.32.5" "cbb4b6ed-f95a-46e4-96c8-1bd35a7c37b8" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:43662 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:37.584Z] "DELETE /v1/api-keys/1d97c938-c7a4-4105-8a7f-49ee423a6473 HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.3" "python-requests/2.32.5" "9c1169a5-4232-4836-ab11-4799085dc322" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:53416 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:40:40.618527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.618576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.622408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.622485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.624189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.624255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:40.624266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:40:40.617Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.2" "python-requests/2.32.5" "14ac8172-de02-4e20-874c-0a2694652b40" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.2:27424 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T20:40:40.752369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:40.752429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:40.768532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:40.768568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:40.917807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.917862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.920565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.920706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.920926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.924457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.924525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:40.924540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.947191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.947231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.949694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.949809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.949986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.953250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:40.953313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:40.953329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.039256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.039300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.041681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.041786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.041997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.045353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.045423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.045434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.065019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.065050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.067440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.067537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.071233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.071284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.071294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.093053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.093087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.095313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.095426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.097354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.097420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.097434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.190629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.190669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.193211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.193322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.193533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.196865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.196920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.196931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.217152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.217188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.220346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.220464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.222471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.222502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.228377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.228540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.228634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.229851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.229904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.229915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.230938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.230985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.230996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.310910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.310952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.313558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.313670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.313849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.317418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.317471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.317481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.338196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.338236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.341271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.341371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.343015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.343071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:41.343084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.363249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.363282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.366255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.366352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.368336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.368372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.374517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.374655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.374743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.376231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.376280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.376290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.377469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.377517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:41.377528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.461942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.461982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.464645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.464756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.464935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.468720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.468772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:41.468783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.489104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.489143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.492418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.492521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.495280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.495315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.502012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.502155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.502258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.503607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.503660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.503670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.504786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.504840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:41.504852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.523239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.523272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.526172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.526275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.528231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.528261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.533883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.534020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.534112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.535255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.535304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.535315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.536275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.536322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T20:40:41.536333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T20:40:41.620598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.620642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.623125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.623236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.623434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.632074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T20:40:41.632127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T20:40:41.632137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T20:40:40.751Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 17 - "100.64.0.4" "python-requests/2.32.5" "3d4571fe-a9d3-4751-b566-2665a3492778" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.48:443 100.64.0.4:43678 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:40.916Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 8 - "100.64.0.3" "python-requests/2.32.5" "522c9244-557b-4c0b-9a90-bf7aa7a30221" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:53428 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:40.946Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 317 7 - "100.64.0.2" "python-requests/2.32.5" "425d75cf-3d2d-45c1-aa45-d279ff46ccc8" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.2:27460 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.038Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 7 - "100.64.0.2" "python-requests/2.32.5" "1533f0bf-6624-47c9-b24a-cb145973a769" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:27438 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.063Z] "DELETE /v1/api-keys/d482fcfe-992a-42e3-a694-7d889195bd04 HTTP/1.1" 200 - via_upstream - "-" 0 253 7 - "100.64.0.4" "python-requests/2.32.5" "7d13a845-133d-46f5-841a-aeb24a5c7269" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:22964 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.091Z] "DELETE /v1/api-keys/d482fcfe-992a-42e3-a694-7d889195bd04 HTTP/1.1" 404 - via_upstream - "-" 0 29 5 - "100.64.0.4" "python-requests/2.32.5" "2891a8a0-616b-4426-bc5a-21f94bc722cb" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:43682 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.189Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.3" "python-requests/2.32.5" "844f380a-619e-4500-859f-178c7b98df5f" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.3:53440 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.221Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "0ec550cc-065f-4ca8-9354-91eb6b441bdb" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:40:41.216Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.2" "python-requests/2.32.5" "7b5098ed-2251-4b59-ae41-66d8d14ef49a" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:27448 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.309Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "ac6d7b7b-2b83-42d9-b78e-f679cc3efd40" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.4:43696 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.337Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.3" "python-requests/2.32.5" "abaf84c4-f796-4d99-8263-0b202f075970" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:53454 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.367Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "5706f9cb-16ab-4b57-88b1-26a5e210ce79" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:40:41.362Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.2" "python-requests/2.32.5" "c1ad2e6a-4dca-4d95-8784-2656a5b8aeaf" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.2:27450 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.460Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.4" "python-requests/2.32.5" "0e106664-76f6-4011-964c-3083d110be3e" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.4:43704 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.494Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.33" "Go-http-client/1.1" "abfb7bc2-6765-4fee-9447-f1a73af87d38" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:40:41.487Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.3" "python-requests/2.32.5" "b0762982-70c7-4727-b37b-ef1b047dd90d" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.3:53468 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.527Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "10.133.0.33" "Go-http-client/1.1" "acc1e091-cda4-4872-b9d3-c5e99c69563d" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.48:56664 10.134.0.48:443 10.133.0.33:34772 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T20:40:41.522Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.2" "python-requests/2.32.5" "eba45ef6-0a5e-44f6-b257-d0aee2d5221e" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:44248 10.134.0.48:443 100.64.0.2:27466 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T20:40:41.619Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 12 - "100.64.0.4" "python-requests/2.32.5" "7353c33c-648d-4279-a1f8-bd43cd97d108" "maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.48:42904 10.134.0.48:443 100.64.0.4:43706 maas.apps.37f3f5d9-e408-499c-a0c8-88c260dda29a.prod.konfluxeaas.com opendatahub.maas-api-route.1