2026-05-29T01:20:09.921027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:09.934767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:09.934949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:09.935207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:09.940272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:09.940348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:09.940364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:20:09.919Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 20 - "100.64.0.2" "python-requests/2.32.5" "05cddc16-08cc-4fcf-be5e-2d9b8a01b56a" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:4134 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:20:17.973328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:17.973385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:17.986564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:17.986827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:17.999306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:17.999354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.008240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.008383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.008509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.010516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.010577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:18.010589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.011681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:18.011743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:18.011753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:20:17.997Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.134.0.39" "Go-http-client/1.1" "e2827f73-05c1-46f2-8c0f-649168876c27" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37938 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-29T01:20:17.972Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 39 - "100.64.0.4" "python-requests/2.32.5" "dcadb66c-b28c-4efe-ba09-877628fe1d39" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:39992 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:20:30.067484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.067533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.081566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.081710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.081975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.085629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.085696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:30.085705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.116614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.116667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.125920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.126051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.126261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.129492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:30.129549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:30.129559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:20:30.066Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 19 - "100.64.0.4" "python-requests/2.32.5" "93e1245b-f16a-40e4-925e-dcb5401108b6" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:25532 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:20:30.115Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 14 - "100.64.0.3" "python-requests/2.32.5" "6acb042a-8655-4504-8540-c2847828f44a" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.3:17576 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:20:38.158403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.158456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.162050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.162170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.164565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.164602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.170390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.170508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.170610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.172358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.172417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:38.172427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.173534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.173589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:20:38.173599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:38.213737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.213799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.216942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.217048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.219153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.219184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.224547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.224663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.224754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.227964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.228020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:38.228030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.229878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:38.229928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:38.229938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:20:38.163Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.134.0.39" "Go-http-client/1.1" "81786d18-e32c-4fe0-8ca7-81ac8b02996f" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37938 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-29T01:20:38.157Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 16 - "100.64.0.2" "python-requests/2.32.5" "f855924a-26fd-4123-ab4d-bea310abb2f8" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:34302 10.132.0.34:443 100.64.0.2:14594 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:20:38.218Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "10.134.0.39" "Go-http-client/1.1" "52a80ce3-1d54-48c4-b067-a484ddc5f589" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:35200 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-29T01:20:38.212Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 17 - "100.64.0.4" "python-requests/2.32.5" "9dc5e44d-5846-4cce-ac94-a145e4125595" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:25538 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:20:43.150Z] "- - HTTP/1.1" 400 DPE http1.codec_error - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.132.0.34:80 100.64.0.4:8336 - - 2026-05-29T01:20:54.695581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:54.695639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:54.709001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:54.709162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:54.711602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.711637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.719203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.719338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.721146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.721206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:54.721217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.722544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.722576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.730340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.730457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.731847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.731901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:54.731911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.733105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.733137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.741864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.741978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.743499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.743551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:20:54.743562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:20:54.744667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:20:54.744746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:20:54.744764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-29T01:20:54.710Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.134.0.39" "Go-http-client/1.1" "39e6b566-7243-4a66-9af5-3175a2d56860" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37938 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-29T01:20:54.721Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.134.0.39" "Go-http-client/1.1" "d87b9031-166b-4554-8eda-4017c93138fb" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:35200 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-29T01:20:54.732Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.134.0.39" "Go-http-client/1.1" "baaa2b3a-a440-4975-86d6-a83e1ccc339b" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:20:54.694Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 50 - "100.64.0.2" "python-requests/2.32.5" "f92f981c-c3a9-4bde-8469-b5fdf42625dd" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:34302 10.132.0.34:443 100.64.0.2:38622 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:21:11.190501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.190559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.203914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.204072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.206578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.206620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.214563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.214697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.216451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.216511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:11.216522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.217716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.217802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:21:11.217818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.241357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.241405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.251161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.251298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.253460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.253494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.262828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.262959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.264561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.264617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:11.264628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:11.265790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:11.265855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:21:11.265870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-29T01:21:11.205Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.134.0.39" "Go-http-client/1.1" "1211be6d-e3e0-4141-b011-7ed4a837320a" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37938 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-29T01:21:11.189Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 28 - "100.64.0.3" "python-requests/2.32.5" "c22faec8-c4cc-4fd6-a13b-83cd000a921e" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:34302 10.132.0.34:443 100.64.0.3:44176 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:21:11.252Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.134.0.39" "Go-http-client/1.1" "0f0ee369-8d03-4694-8d4d-7e9745da56b7" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:35200 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-29T01:21:11.240Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 25 - "100.64.0.3" "python-requests/2.32.5" "40ff6279-6787-4f87-9d8c-af8db7197a1b" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:34302 10.132.0.34:443 100.64.0.3:16744 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:21:20.352869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:20.352921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:20.354342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:20.354379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-29T01:21:20.351Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "c73dbc5e-f359-4b42-b008-8f06dfab0e05" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.34:443 100.64.0.4:31642 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:21:36.965582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.965631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.981093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.981237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.981474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.987390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:36.987452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:36.987462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.012717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.012760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.019891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.020013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.020318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.020350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.021697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.021723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.022000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.025364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.025505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.025687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.026328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.043701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.043742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.049949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.050067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.050318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.050348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.050941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.050966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:21:37.073222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.073262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.079180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.079297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.079576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.079608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.080169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.080195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.101231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.101271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.104062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.104174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.106676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.106706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.112173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.112287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.112383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.115388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.115443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:37.115453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.116795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:37.116843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:37.116853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:21:36.964Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 23 - "100.64.0.2" "python-requests/2.32.5" "4164032e-8717-4b93-b493-0b54a74c69f7" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:58832 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:21:37.012Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 14 - "100.64.0.3" "python-requests/2.32.5" "d3a09275-a0ae-45c5-bac2-81b69d54abbb" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:41928 10.132.0.34:443 100.64.0.3:17938 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-29T01:21:37.043Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.4" "python-requests/2.32.5" "560019a9-fbab-47c9-a05b-393f00997c39" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:43970 10.132.0.34:443 100.64.0.4:48886 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-29T01:21:37.072Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "a8020ab6-4794-4776-8370-f9237d0f5a44" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:41928 10.132.0.34:443 100.64.0.2:58846 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-29T01:21:37.106Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.134.0.39" "Go-http-client/1.1" "cdb4ed69-0bd4-4e21-8e8f-7dd68b631e45" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:41942 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:21:37.100Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.3" "python-requests/2.32.5" "ce419f9b-f1dd-457a-95de-f4f4455c182e" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.3:17954 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:21:37.634Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.132.0.34:443 100.64.0.4:48900 - - 2026-05-29T01:21:46.173743Z info ads ADS: new connection for node:6 2026-05-29T01:21:46.175840Z info cache read certificate from file resource=file-root:system 2026-05-29T01:21:52.841158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.841208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.856222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.856375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.856627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.860629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:52.860696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:52.860707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.216327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.216375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.217356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.217393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.246978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.247022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.247958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.247990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.271008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.271045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.277475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.277604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.277882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.277912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.279259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.279284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.279509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.280502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:21:53.280614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:21:53.280624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:21:52.839Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 20 - "100.64.0.2" "python-requests/2.32.5" "e70e7c0d-8b77-4992-a4cd-a888db6b54f2" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:32870 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:21:53.215Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "38fbcdb7-49d9-4347-8e31-fb2f24e10ad5" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.34:443 100.64.0.2:59424 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-29T01:21:53.246Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "4367b835-a460-4399-9999-e53fc69d9c46" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.34:443 100.64.0.4:9028 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-29T01:21:53.270Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 10 - "100.64.0.3" "python-requests/2.32.5" "7350556a-3202-4313-9dcc-03dfe19598e4" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.34:443 100.64.0.3:5242 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.e2e-external-model.0 2026-05-29T01:22:30.953229Z info ads ADS: "" 6 terminated 2026-05-29T01:22:32.793373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.793423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.796033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.796161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.796358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.809500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.809559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:32.809570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.902015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.902066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.929880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.929923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.954370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.954414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.955746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.955791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.974960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.975002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.976243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:32.976273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.340028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.340078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.342721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.342857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.343071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.346624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.346677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:33.346687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.553878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.553923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.556602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.556716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.556924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.560238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.560292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:33.560303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.582772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.582843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.586765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.586906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.589497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.589530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.596590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.596814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.596930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.598569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.598625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:33.598635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.600079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.600129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:33.600139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.619917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.619956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.626574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.626714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.626994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.627025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.628574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.628600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.628848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.630696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.630852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.631027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.631512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:33.715176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.715224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.717702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.717842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.718048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.721178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.721234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:33.721244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.741518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.741556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.744184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.744293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.747857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:33.747909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:33.747919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:22:32.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 17 - "100.64.0.3" "python-requests/2.32.5" "6f888b28-3b8d-4c22-9d11-45309075b54c" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.3:49334 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:32.900Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 29 - "100.64.0.4" "python-requests/2.32.5" "e0793c7a-bb3e-4b10-bfd5-fd0b598c36cb" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.34:443 100.64.0.4:58066 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:32.953Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 2 - "100.64.0.2" "python-requests/2.32.5" "5afa40a7-98a0-4dd7-a888-809168322a1b" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.34:443 100.64.0.2:54034 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:32.973Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.4" "python-requests/2.32.5" "20a89459-7511-4aaf-ba4d-34978dae0d4f" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.34:443 100.64.0.4:57620 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:33.338Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 7 - "100.64.0.2" "python-requests/2.32.5" "beebcc8f-88c9-495c-abdf-97aedd45f03e" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.2:61442 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:33.552Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.3" "python-requests/2.32.5" "78cb9cc1-6ca7-4b07-aba4-3b8505c739bf" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.3:18090 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:33.588Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.134.0.39" "Go-http-client/1.1" "87679465-0e70-4c01-8fa4-7c20448e7013" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:22:33.581Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 18 - "100.64.0.4" "python-requests/2.32.5" "bcb616cc-0051-4772-b046-ec5d31dbda5f" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:58078 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:33.619Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 325 12 - "100.64.0.3" "python-requests/2.32.5" "65b53c81-9566-4f2b-a4fb-4e466fb31d60" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:38168 10.132.0.34:443 100.64.0.3:49340 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-29T01:22:33.714Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.2" "python-requests/2.32.5" "912d0f5c-8bc1-4841-8892-343990aaa3a1" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:54042 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:33.740Z] "DELETE /v1/api-keys/b4e77431-6027-4ff4-947d-833030db3ab6 HTTP/1.1" 200 - via_upstream - "-" 0 251 7 - "100.64.0.4" "python-requests/2.32.5" "5e8712df-8919-4580-ac4a-ffbd4f65b628" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:57622 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:22:36.769899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:36.769961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:36.773386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:36.773486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:36.775459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:36.775524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:36.775541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-29T01:22:36.768Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 6 - "100.64.0.2" "python-requests/2.32.5" "671f2e45-9b6b-4090-8377-6cbbb71ff943" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.2:21616 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-29T01:22:36.908634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:36.908683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:36.925683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:36.925724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.074240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.074297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.076927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.077061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.077272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.080591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.080657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.080672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.099864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.099909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.102389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.102506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.102695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.105560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.105626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.105641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.191804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.191862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.194519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.194659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.194892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.197932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.197998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.198013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.222474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.222515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.224895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.225008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.228422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.228475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.228485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.247158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.247193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.249599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.249705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.251680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.251731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.251741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.339832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.339885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.342322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.342456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.342659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.345636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.345704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.345719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.363990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.364027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.367029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.367153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.369094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.369125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.374824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.374960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.375057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.376571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.376624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.376634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.377609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.377658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.377668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.468517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.468572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.471138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.471277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.471494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.474800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.474869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.474884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.491975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.492022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.495109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.495219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.496931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.496982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.496992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.514371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.514415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.517350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.517478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.519505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.519538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.525183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.525320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.525419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.527037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.527098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.527109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.528129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.528177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.528187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.612618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.612671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.615266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.615386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.615585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.618603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.618655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.618665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.640185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.640222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.643183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.643292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.645104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.645135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.651570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.651705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.651826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.653293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.653347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.653357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.654326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.654375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.654385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.673440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.673479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.676142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.676251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.678160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.678192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.683515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.683642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.683737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.685123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.685179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.685190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.686231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.686284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-29T01:22:37.686295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-29T01:22:37.768538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.768586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.771201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.771319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.771511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.774624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-29T01:22:37.774681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-29T01:22:37.774692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-29T01:22:36.907Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 18 - "100.64.0.3" "python-requests/2.32.5" "4ff0b237-7a6b-4191-9358-e3561311f31a" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.34:443 100.64.0.3:49344 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.073Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 7 - "100.64.0.2" "python-requests/2.32.5" "fa0a6e75-4d5a-4268-a51f-05fd0446cd98" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.2:54044 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.098Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 317 6 - "100.64.0.3" "python-requests/2.32.5" "d87105e6-ffce-4acf-b713-6509ab74c96f" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.3:37878 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.190Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 7 - "100.64.0.4" "python-requests/2.32.5" "dee5e5f4-dd87-4b65-93e8-155f50abd697" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.4:57624 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.221Z] "DELETE /v1/api-keys/7b072e42-841a-435c-be82-de1bf3cf4d18 HTTP/1.1" 200 - via_upstream - "-" 0 253 7 - "100.64.0.4" "python-requests/2.32.5" "e505ad70-6067-4968-bb58-b5b788dc14ff" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:6704 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.246Z] "DELETE /v1/api-keys/7b072e42-841a-435c-be82-de1bf3cf4d18 HTTP/1.1" 404 - via_upstream - "-" 0 29 5 - "100.64.0.2" "python-requests/2.32.5" "e6d21dde-af68-4b6e-87ea-803df96f8892" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:21618 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.338Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.3" "python-requests/2.32.5" "665be6c5-a436-4e4c-b5ec-ad34f0231361" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.3:37894 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.368Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.39" "Go-http-client/1.1" "6346180a-7547-49fa-af54-32da3aa0036a" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:22:37.362Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "1e4b6407-2d40-49e7-9ffa-5aaeefdd5980" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:6712 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.467Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.2" "python-requests/2.32.5" "9a1e3ed2-0194-4bfe-9903-6c43545185bb" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.2:21624 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.490Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.3" "python-requests/2.32.5" "7c99cdf8-d9be-4d8a-bed2-d98b718af778" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.3:37908 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.518Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.39" "Go-http-client/1.1" "5f8b0b2f-c88c-4d9a-9743-b088b2156237" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:22:37.513Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "fe52cc21-2ea3-4d6a-9b66-5022bdd3afc6" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:6722 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.611Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.2" "python-requests/2.32.5" "896cda6f-ee74-43d0-bf02-86923730c50b" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.2:21634 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.644Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.134.0.39" "Go-http-client/1.1" "bd849726-f159-44bb-8057-39cd69001f03" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:22:37.639Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "22ea8e12-97f1-4ec2-9012-058a2dc004e7" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.3:49350 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.677Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "10.134.0.39" "Go-http-client/1.1" "6e120156-c41f-486a-a34a-7dbeab387101" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:37314 10.132.0.34:443 10.134.0.39:46014 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-29T01:22:37.672Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 13 - "100.64.0.2" "python-requests/2.32.5" "183e7b54-a3cd-4ded-957e-d5d34566bb72" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:55812 10.132.0.34:443 100.64.0.2:54050 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-29T01:22:37.767Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.4" "python-requests/2.32.5" "2a70ba7b-3596-4f59-8972-40ead173be68" "maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.34:42834 10.132.0.34:443 100.64.0.4:57636 maas.apps.3538c35e-ac3d-4be5-af6f-d945386c3d97.prod.konfluxeaas.com opendatahub.maas-api-route.1