2026-04-21T15:35:21.323148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.323198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.326565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.326691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.326851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.327565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.327610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:21.327643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:21.327652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:35:21.321Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.4" "python-requests/2.32.5" "f7ad8f13-57eb-4cc8-8084-2dcdbfaff0ae" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:13632 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:26.353900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.353958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.357530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.357664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.357840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.360440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.360499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.360546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:26.360560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:26.381268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.381311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.384291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.384414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.385343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.385389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:26.385419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:35:26.385428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:35:26.352Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "108c9bd7-b223-4595-96a1-a43bda2631ed" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:24470 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:35:26.380Z] "DELETE /v1/api-keys/e1359c0b-48ff-4b97-bc59-3f9dfbff5d16 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "707478a1-2174-4ffb-9bc4-8aee1557e74c" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:43558 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:31.413202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.413285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.416856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.416988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.423557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.423616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.423656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:31.423670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.614313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.614359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.633311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.633353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.802121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.802182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.805478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.805642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.805853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.806596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.806666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:31.806709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:31.806722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:35:31.412Z] "DELETE /v1/api-keys/e1359c0b-48ff-4b97-bc59-3f9dfbff5d16 HTTP/1.1" 404 - via_upstream - "-" 0 29 11 - "100.64.0.3" "python-requests/2.32.5" "e7f1bc9f-85e0-4c12-9e4d-8de87a037372" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:39430 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:35:31.613Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 20 - "100.64.0.4" "python-requests/2.32.5" "c980d056-8734-4413-b47c-8981528e93bd" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.44:443 100.64.0.4:40550 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:35:31.800Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 6 - "100.64.0.2" "python-requests/2.32.5" "c245fec4-efcb-4128-89c0-5703e8e6305c" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:22444 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:36.831896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.831962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.835702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.835836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.836007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.836739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.836785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:36.836820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:35:36.836829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:35:36.069Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.44:443 100.64.0.3:53258 - - [2026-04-21T15:35:36.830Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 6 - "100.64.0.4" "python-requests/2.32.5" "890d7b10-b312-483f-a791-7294db72d288" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:39816 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:41.864941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.864997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.868531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.868676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.868863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.869645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.869705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:41.869748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:41.869762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:35:41.863Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 6 - "100.64.0.2" "python-requests/2.32.5" "0ac826ee-85cc-4134-977c-c9b93e27d0d7" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:5890 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:46.898511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.898568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.901959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.902094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.902295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.903060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.903114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:46.903158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:35:46.903171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:35:46.897Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 5 - "100.64.0.4" "python-requests/2.32.5" "28dcfcc3-fd61-4836-8c7a-066dddab8b6b" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:54658 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:51.930637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.930687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.934158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.934308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.934466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.935289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.935337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:35:51.935371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:35:51.935380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:35:51.929Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 5 - "100.64.0.3" "python-requests/2.32.5" "ffec36b6-99be-4bfb-a25b-e4df1c3e1ba7" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:34078 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:55.870531Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-04-21T15:35:56.965668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.965721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.969137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.969288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.969456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.972297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.972349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.972384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:56.972394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.995230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.995295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.999031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.999137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:56.999306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.001598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.001643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.001675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:57.001684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:35:56.964Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 7 - "100.64.0.2" "python-requests/2.32.5" "061526e8-c6e9-4a81-922f-657fefafb088" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:53394 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:35:56.994Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 317 7 - "100.64.0.3" "python-requests/2.32.5" "97e8cc97-4163-4ac4-bfa8-cd762871f1dc" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:14484 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:35:57.092333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.092381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.095778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.095895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.096054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.096779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.096829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:35:57.096866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:35:57.096876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:35:57.091Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.4" "python-requests/2.32.5" "d0aa10a5-8da8-473e-82f1-2f10abc19663" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:60998 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:02.124357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.124408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.127685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.127810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.127969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.130582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.130640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.130672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:02.130682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.158532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.158578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.161752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.161870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.162669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.162714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:02.162745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:02.162754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:02.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 316 7 - "100.64.0.2" "python-requests/2.32.5" "c32ef494-1508-4779-9409-488cca0b3ff3" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:53192 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:36:02.157Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.3" "python-requests/2.32.5" "5d547b03-4d56-4203-9444-700c495f063d" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:48930 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:07.194206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.194280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.197488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.197602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.198432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.198479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:07.198507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:07.198516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:07.193Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.4" "python-requests/2.32.5" "3a093974-bece-4c53-a523-1671ecefd53a" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:63240 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:12.224452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.224504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.228013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.228130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.229008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.229058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:12.229089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:12.229098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:12.223Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.3" "python-requests/2.32.5" "1eafd0b8-dc04-4ee8-a590-11d67ff4b22d" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:41968 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:17.257726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.257777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.261109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.261264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.262259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.262315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:17.262346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:17.262355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:17.256Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "8cddc64e-1531-4c6f-9c4c-bc44988ce898" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:40914 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:22.288890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.288939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.292486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.292595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.293478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.293526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:22.293559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:22.293567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:22.287Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "e823c829-1b83-4958-ba45-1f5dfa316c7d" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:38020 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:27.323125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.323175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.326481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.326596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.327446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.327492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:27.327522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:27.327531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:36:27.321Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.4" "python-requests/2.32.5" "04a210d2-b05b-9f63-bbe9-2b468056d8d3" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:43126 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:32.354596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.354683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.358044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.358159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.361949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.361995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.362027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:32.362037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:32.387779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.387834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.391224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.391400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.392313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.392377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:32.392425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:32.392439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:32.353Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 200 - via_upstream - "-" 0 253 8 - "100.64.0.3" "python-requests/2.32.5" "9c8b54f4-8f40-4570-a2a3-60fb8ec216e2" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:1084 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:36:32.386Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 6 - "100.64.0.4" "python-requests/2.32.5" "e1f4f8fe-e3a2-4ae7-b069-22e2cc2b383a" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:54066 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:37.415815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.415866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.419233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.419361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.420270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.420319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:37.420349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:37.420358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:36:37.414Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "2bb26497-6fe6-45c8-aa82-b83803f145d2" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:9644 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:42.448297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.448355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.452080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.452231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.453202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.453292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:42.453334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:42.453346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:36:42.447Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 6 - "100.64.0.3" "python-requests/2.32.5" "c6f7c8be-cd1f-4b3e-b563-5d9db5520dca" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:56198 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:47.482485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.482534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.485803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.485920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.486776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.486822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:47.486853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:47.486862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:36:47.481Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.4" "python-requests/2.32.5" "a455fc2d-5886-4e1f-a275-916a64993f03" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:4640 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:52.515303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.515350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.518739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.518865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.519777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.519826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:52.519858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:52.519867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:52.514Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.3" "python-requests/2.32.5" "85909367-b249-4a73-ba67-92415baedaa3" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:7870 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:36:57.546514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.546562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.549959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.550070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.556355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.556409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.556450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:36:57.556464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:36:57.655004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.655061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.658553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.658703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.658882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.661682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.661734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.661767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:57.661776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.683894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.683934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.699476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.699606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.711221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.711273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.718363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.718506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.718657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.719398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.719446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.719480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:57.719489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.720686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.720727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.720758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:57.720765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.812337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.812380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.815761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.815873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.816023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.816746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.816790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:36:57.816819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:36:57.816828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:36:57.134Z] "GET / HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.2" "python-requests/2.32.5" "061137f9-dd75-4819-9198-bf9bc97bdd35" "52.0.175.49" "-" - - 10.133.0.44:80 100.64.0.2:14996 - - [2026-04-21T15:36:57.545Z] "DELETE /v1/api-keys/bd9623f5-257f-4e5a-9f62-569d09755152 HTTP/1.1" 404 - via_upstream - "-" 0 29 11 - "100.64.0.2" "python-requests/2.32.5" "2d382073-6165-43f7-8abd-b6cca51660a0" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:15926 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:36:57.653Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 312 7 - "100.64.0.4" "python-requests/2.32.5" "1405c73d-d463-486e-a69a-df2657352513" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:40944 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:36:57.710Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "100.64.0.3" "Go-http-client/1.1" "3ec50b6c-d025-4e40-9a3c-e8546e254a4c" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:32962 10.133.0.44:443 100.64.0.3:19432 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:36:57.682Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 37 - "100.64.0.2" "python-requests/2.32.5" "42cc92c7-1b91-4a05-bc1f-b9baf265b1e4" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:3958 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:36:57.811Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "b35d1fb6-dc06-4706-a6b8-2091c981a43b" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:15934 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:02.847691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.847744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.851052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.851175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.851356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.852098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.852144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:02.852174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:02.852184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:02.846Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "97ccde02-a1c5-4cbb-b156-b591452a250d" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:19016 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:07.885655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.885704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.889072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.889199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.889400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.890174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.890222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:07.890282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:37:07.890292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:37:07.884Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "e4a66ba9-6033-4aeb-8f84-14181c3fdba2" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:16156 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:12.915880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.915932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.920794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.920953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.921144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.921958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.922008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:12.922039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:12.922048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:12.914Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 7 - "100.64.0.2" "python-requests/2.32.5" "e7f97ff0-c6f0-4d42-aed0-f8d5dda55f18" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:32776 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:17.955230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.955298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.958911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.959027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.959182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.959912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.959959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:17.959991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:37:17.960001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:37:17.954Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "9b72ec22-7eb6-950d-963f-8f7bf0f43487" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:17376 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:22.993580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.993638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.997180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.997331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.997512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.998333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.998379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:22.998409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:22.998418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:22.992Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.3" "python-requests/2.32.5" "9afd231f-36fe-412a-8ab1-3961be4a3fd5" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:58850 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:28.038781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.038829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.042020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.042135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.042308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.043046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.043092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:28.043123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:37:28.043133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:37:28.037Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "1d3d0ec7-3346-4d70-b14f-6d97b6510d1c" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:64782 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:33.069445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.069491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.072906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.073021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.073175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.073977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.074026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:33.074056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:33.074065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:33.068Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "c5446741-bee3-4ba3-b506-da0ae334ce6e" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:21736 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:38.104202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.104301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.107591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.107779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.107991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.108803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.108866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:38.108908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:38.108921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:38.102Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.3" "python-requests/2.32.5" "f0afb9dd-8c83-4511-8241-f0f1af848c97" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:15010 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:43.137816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.137866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.141259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.141398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.141574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.142393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.142444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:43.142477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:43.142486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:43.136Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "370074dc-5f61-4b5b-a8bb-a814cb382339" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.4:59658 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:48.170811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.170865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.174175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.174344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.174526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.175369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.175424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:48.175464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:48.175477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:37:48.169Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "ad76c584-1458-4360-80be-784faf640e23" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.2:58724 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:53.202512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.202565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.206443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.206564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.206733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.207522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.207576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.207608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:37:53.207618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:37:53.310100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.310148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.313533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.313647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.313796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.314506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.314554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:53.314585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:37:53.314594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:37:53.201Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.3" "python-requests/2.32.5" "cb668984-1974-4230-baee-97fa12ddfac8" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:26918 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:37:53.308Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "67fc2714-15b5-47c2-a994-985e704c1523" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:7996 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:37:58.343473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.343530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.346910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.347053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.347234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.347974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.348031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:37:58.348073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:37:58.348086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:37:58.342Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "4c9a4aa5-a57f-96c8-91cb-70fe511726b3" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:57742 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:38:03.375952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.376015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.379964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.380107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.380309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.380991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.381051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:03.381094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:03.381107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:38:03.374Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.4" "python-requests/2.32.5" "191c94d1-f86a-42d2-ab7a-b5f611982d13" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:5068 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:38:08.411496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.411544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.414889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.415005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.415160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.415901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.415944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:38:08.415974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:38:08.415983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:38:08.410Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "81762310-b52a-4ade-82e3-6577b5ebd59f" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:38972 10.133.0.44:443 100.64.0.3:17598 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:38:13.445571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.445631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.449119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.449269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.449449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.454441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.454498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.454543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.454557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.478037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.478086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.492585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.492715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.506310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.506353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.512480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.512626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.512724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.513384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.513429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.513462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.513471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.514569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.514608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.514646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.514656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.537037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.537074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.540826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.540919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.542842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.542873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.548875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.549009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.549099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.549718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.549759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.549790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.549799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.550838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.550874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.550908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.550917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.648717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.648763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.652117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.652223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.652382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.654590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.654632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:38:13.654673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:38:13.654683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:38:13.444Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 10 - "100.64.0.3" "python-requests/2.32.5" "fa05c298-a453-4805-b33f-9104b7477f97" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.3:8624 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:38:13.505Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "b45fb000-35c1-471d-bb5a-41d0467028cf" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:32962 10.133.0.44:443 100.64.0.2:49492 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:38:13.477Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 37 - "100.64.0.2" "python-requests/2.32.5" "8a398c68-b11d-43a4-bd30-b5a5d7664310" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.2:61432 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:38:13.542Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.2" "Go-http-client/1.1" "b3fcce1a-29c6-484d-8242-b348e3fec091" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:32962 10.133.0.44:443 100.64.0.2:49492 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:38:13.536Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "339a627c-fb1d-45b9-a644-354eb3397cdc" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:3758 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:38:13.647Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.4" "python-requests/2.32.5" "e33bcba2-9c87-4ca1-a9b7-75ac53b312e1" "maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com" "10.134.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:48528 10.133.0.44:443 100.64.0.4:2140 maas.apps.c55b3d15-2aa0-4c09-b509-0593bde36a60.prod.konfluxeaas.com opendatahub.maas-api-route.1