2026-04-21T15:07:35.098558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:35.098688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:35.099223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:35.099267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:35.099294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:07:35.099303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:07:34.905Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.4" "python-requests/2.32.5" "94ed370e-a21c-4906-a73d-9ba37b1642a0" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:20110 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:07:34.956Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.4" "Go-http-client/1.1" "8186b616-f309-40ab-b2e2-1b2b32cdba59" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:36820 10.134.0.36:443 100.64.0.4:50036 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:07:34.931Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 34 - "100.64.0.3" "python-requests/2.32.5" "97b4be72-c6c9-4982-b6e0-18ba265f4248" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:50124 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:07:34.981Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 350 10 - "100.64.0.2" "python-requests/2.32.5" "2d397c76-a49a-4354-b59c-9a57627800b0" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37972 10.134.0.36:443 100.64.0.2:9876 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-21T15:07:35.073Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 6 - "100.64.0.3" "python-requests/2.32.5" "000673f5-73e9-411a-b6e0-de2f84230023" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:2922 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:07:35.094Z] "DELETE /v1/api-keys/e8aa6f3b-4553-487e-a748-b7307d235bf1 HTTP/1.1" 500 - via_upstream - "-" 0 96 4 - "100.64.0.4" "python-requests/2.32.5" "f7b70ecc-fcdd-4ce2-8e5a-d783c592f021" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:20122 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:40.123333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.123384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.126515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.126663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.130337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.130385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:40.130417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:07:40.130426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:07:40.122Z] "DELETE /v1/api-keys/e8aa6f3b-4553-487e-a748-b7307d235bf1 HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.2" "python-requests/2.32.5" "ea6e7c74-3807-4c82-8107-083695406b37" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:43086 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:43.154421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.154475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.157642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.157678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.277117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:43.277213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:43.300327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:43.300370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:07:43.153Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 4 - "100.64.0.3" "python-requests/2.32.5" "9c679e94-50a2-48b6-934f-bcd7d9707386" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.36:443 100.64.0.3:48762 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:07:43.275Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 24 - "100.64.0.2" "python-requests/2.32.5" "7fb176fa-581f-4921-8b1e-b9156af410b3" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.36:443 100.64.0.2:9650 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:43.445071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.445118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.448540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.448680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.448843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.449341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.449410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:43.449458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:07:43.449473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:07:43.443Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 5 - "100.64.0.3" "python-requests/2.32.5" "29257e96-651a-43a3-b5e4-6abc8717e8e8" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:47600 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:48.471802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.471854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.475881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.476036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.476235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.476820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.476883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:48.476928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:07:48.476942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:07:48.470Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 6 - "100.64.0.2" "python-requests/2.32.5" "25ed8949-491c-4600-af9a-47a89cde0712" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:63266 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:53.503449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.503509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.506708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.506847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.507031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.507529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.507613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:53.507655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:07:53.507669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:07:53.502Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 5 - "100.64.0.4" "python-requests/2.32.5" "735e051a-4270-4e17-8876-1d43ef456902" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:50372 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:07:58.535877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.535931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.539196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.539332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.539498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.542169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.542232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.542268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:07:58.542277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:07:58.561030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.561073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.564657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.564783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.564946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.565414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.565472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:07:58.565513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:07:58.565525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:07:58.534Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 7 - "100.64.0.3" "python-requests/2.32.5" "1c7b27bf-e2bf-4772-9b43-b4afd9c299d6" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:53044 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:07:58.559Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.2" "python-requests/2.32.5" "f3395d9e-576b-4743-9ab9-1ac006379699" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:33994 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:03.592441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.592491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.595710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.595844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.596011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.596482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.596532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:03.596576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:03.596586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:03.591Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.4" "python-requests/2.32.5" "5ccba170-d30d-40b1-9700-500b933b1358" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:10682 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:08.624806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.624855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.628111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.628240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.628404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.628930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.628984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:08.629016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:08.629025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:08.623Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.2" "python-requests/2.32.5" "e6b12ac6-9983-4fa2-9eac-0f5f9f2f9f61" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:43058 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:13.657323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.657382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.660802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.660928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.661094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.661613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.661662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:13.661695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:13.661702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:13.656Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.2" "python-requests/2.32.5" "318bc2a0-f0ee-44a2-aa88-d9bfcdc67748" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.2:43332 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:18.685669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.685727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.689650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.689796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.689978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.690527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.690605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:18.690642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:18.690651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:18.684Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 6 - "100.64.0.4" "python-requests/2.32.5" "309c4f7b-5fa7-41e3-91ff-60026fc0dd33" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:44486 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:23.719616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.719665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.722843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.722973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.723131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.723641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.723690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:23.723720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:23.723729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:23.718Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.3" "python-requests/2.32.5" "4ced5e89-d229-4865-adac-4513c9f28014" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:6244 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:28.749477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.749527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.752665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.752800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.752975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.753498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.753552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:28.753608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:28.753621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:28.748Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.4" "python-requests/2.32.5" "ce649150-dc35-4653-86f8-b74514b0998b" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:48710 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:33.798933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.798993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.802633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.802789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.802992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.805763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.805832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.805879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:33.805893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.893727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.893773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.896994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.897124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.897293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.897782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.897830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:33.897860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:33.897869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:33.797Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 317 8 - "100.64.0.3" "python-requests/2.32.5" "84925870-c715-42de-8a7d-3a7a9c39957a" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:4958 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:08:33.892Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.3" "python-requests/2.32.5" "72ddd095-e447-46f1-b99b-01d1a33047bf" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:52082 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:38.926358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.926414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.929587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.929717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.929881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.930352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.930401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:38.930432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:38.930441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:38.925Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.2" "python-requests/2.32.5" "541a4717-16b8-4ce0-b6d2-c8602b91400c" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.2:27588 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:43.960821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.960908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.964725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.964856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.965031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.965536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.965618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:08:43.965661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:08:43.965671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:08:43.959Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 6 - "100.64.0.4" "python-requests/2.32.5" "e6d42f66-d2a8-4edf-a6c0-7af141f7b006" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:7808 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:48.993754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.993804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.997090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.997227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.997410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.997925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.997982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:48.998015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:48.998024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:48.992Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.2" "python-requests/2.32.5" "958263b9-e06d-4d69-abac-f7880030056e" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:53184 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:54.027046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.027101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.030423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.030559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.030762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.031233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.031285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:54.031317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:54.031326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:54.025Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.3" "python-requests/2.32.5" "40b3e0ee-c382-49b5-9135-500e637fc372" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.3:39480 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:08:59.058887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.058937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.062496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.062639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.062807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.063335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.063389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:08:59.063422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:08:59.063431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:08:59.057Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.4" "python-requests/2.32.5" "9f20013f-9d07-45fb-98b2-8ab2e91669e5" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:7918 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:04.089965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.090022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.093441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.093587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.093753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.094236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.094289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:04.094320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:04.094329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:04.088Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.2" "python-requests/2.32.5" "aba6c85c-2785-4e64-a6ac-7d1c15fbf9d1" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:12718 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:09.120911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.120970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.124143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.124291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.124475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.124976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.125034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:09.125076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:09.125090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:09.119Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.3" "python-requests/2.32.5" "a11ede91-3188-413d-bb74-388d08e5c00f" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.3:15238 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:14.152082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.152130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.155439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.155579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.155741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.156228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.156278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:14.156308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:14.156316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:14.150Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 31 96 5 - "100.64.0.4" "python-requests/2.32.5" "48e820ae-ae8c-4b06-aab8-c3ec301548d2" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:64392 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:19.181637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.181686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.184834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.184961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.185137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.188689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.188744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.188777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:19.188786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:19.212061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.212107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.215158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.215277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.215822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.215870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:19.215900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:19.215909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:19.180Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 316 8 - "100.64.0.3" "python-requests/2.32.5" "a7755827-d913-46fd-a7c5-de6acc83f64c" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:14666 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:19.210Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 500 - via_upstream - "-" 0 96 4 - "100.64.0.2" "python-requests/2.32.5" "3520f0ad-405d-40b2-97de-7a52c82664dd" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:42730 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:24.243389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.243445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.246480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.246636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.247247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.247305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:24.247348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:24.247361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:09:24.242Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.3" "python-requests/2.32.5" "ce0ccde3-7964-4a7d-898c-3fc34c0bc241" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:32484 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:29.281718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.281767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.285234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.285370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.285980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.286028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:29.286059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:29.286068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:29.280Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "e89c1ba0-fb6f-4c3a-82d3-92e565fbdc89" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:54852 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:34.312520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.312601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.315758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.315889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.316594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.316661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:34.316706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:34.316720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:09:34.311Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.4" "python-requests/2.32.5" "9d277a94-4646-4999-9ff2-e530e97b9695" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:11728 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:39.346775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.346823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.350044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.350167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.350779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.350825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:39.350855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:39.350863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:39.345Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.3" "python-requests/2.32.5" "e2dc0be4-d622-4c27-a350-89896335fe8b" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.3:18028 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:44.379957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.380014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.383485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.383652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.389507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.389599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.389647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.389661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:09:44.378Z] "DELETE /v1/api-keys/beebcbf8-33ff-4589-a1ac-0be1343daf7b HTTP/1.1" 404 - via_upstream - "-" 0 29 10 - "100.64.0.4" "python-requests/2.32.5" "3c91d07d-0069-4b63-b903-169ef193b077" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:44610 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:44.551682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.551730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.554906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.555035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.555197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.557518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.557585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.557619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.557628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.580131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.580182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.593616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.593768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.605897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.605939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.612557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.612738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.612868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.613558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.613664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.613714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.613728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.614811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.614860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.614892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.614902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.699715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.699766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.703363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.703501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.703706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.705959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.706014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.706047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.706057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.725805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.725845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.729648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.729766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.730266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.730311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.730341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.730349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.745132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.745172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.749113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.749237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.751130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.751166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.757067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.757227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.757363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.758045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.758103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.758145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.758158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.759248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.759309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.759354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:44.759367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:44.844335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.844385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.847536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.847695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.847858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.848336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.848386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:44.848416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:44.848425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:09:44.550Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "ced98827-7c44-4cf7-8cc8-aef9419a2ae1" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:23020 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:44.604Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "1d344f52-60cd-41f4-acec-6d108ca43849" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37972 10.134.0.36:443 100.64.0.2:4048 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:09:44.579Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 35 - "100.64.0.2" "python-requests/2.32.5" "df813cf6-6d18-460c-8c6a-1af18247f61d" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.2:64842 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:44.698Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.4" "python-requests/2.32.5" "77c27098-c3eb-4d29-824b-a57a9389fd6f" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:44616 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:44.724Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 5 - "100.64.0.3" "python-requests/2.32.5" "50e55b20-d642-4f51-b643-1eb2a1958236" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:23032 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:44.750Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.2" "Go-http-client/1.1" "ec3b0e7d-847a-4a10-94a7-07c5c3a2fdd9" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37972 10.134.0.36:443 100.64.0.2:4048 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:09:44.744Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.4" "python-requests/2.32.5" "e1a5950d-a7dc-48db-a6a4-34b7d24c064e" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:29202 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:09:44.843Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "1f4f809d-63a0-4226-b2f3-98bf726251cc" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:18034 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:49.870491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.870547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.873709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.873841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.874024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.874519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.874587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:49.874619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:49.874628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:49.869Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "d6973b1b-dc38-4b4c-b3a8-16ad20577ad8" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.2:64844 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:54.911101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.911151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.914377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.914505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.914692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.915149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.915196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:09:54.915226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:09:54.915235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:09:54.909Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "b589202b-53e3-448f-a5ed-76c3782eaeb2" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.2:20800 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:09:59.945308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.945369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.948720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.948855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.949023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.949523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.949596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:09:59.949632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:09:59.949642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:09:59.944Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "ea8b15cb-7739-4f8f-a92e-8d29f64597f8" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:17520 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:10:04.973941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.974000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.977411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.977551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.977745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.978217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.978265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:04.978295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:10:04.978304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:10:04.972Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "8b415a7f-0f7d-4cf3-b8ac-0b86a72592c4" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.3:5168 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:10:10.005041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.005092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.008280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.008411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.008592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.009046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.009090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:10.009121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:10:10.009129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:10:10.003Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "ab5c9f19-52e9-4f8a-8338-3202083393ac" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.4:42474 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:10:15.037221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.037286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.040706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.040849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.041025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.043838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.043890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.043919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:10:15.043928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.065729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.065776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.069993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.070141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.073018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.073060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.079398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.079545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.079697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.080412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.080466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.080498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:10:15.080507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.082461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.082512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.082549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:10:15.082559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.097443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.097481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.101130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.101255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.103155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.103195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.109415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.109555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.109688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.110413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.110460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.110492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:10:15.110501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.111557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.111631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.111669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:10:15.111679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:15.199548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.199619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.202809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.202937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.203107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.203624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.203670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-21T15:10:15.203701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-21T15:10:15.203710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-21T15:10:15.036Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "c471b6f4-4756-4bb7-84b2-203c2754bdbc" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:59614 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:10:15.072Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "a46cd1a7-9c3b-46dd-8f06-c6f4ee39952a" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37972 10.134.0.36:443 100.64.0.2:4048 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:10:15.064Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.3" "python-requests/2.32.5" "97fa05d8-68ac-4f5e-8235-6d41504ae782" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.3:58442 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:10:15.102Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "2eea1e3a-6f17-41f4-8957-bbb760e30c9f" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.36:37972 10.134.0.36:443 100.64.0.2:4048 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-21T15:10:15.096Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "8e5c736e-d869-435b-b21a-1f4a93d3f0bf" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.3:37848 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-21T15:10:15.198Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 36 96 5 - "100.64.0.2" "python-requests/2.32.5" "8ca76ab5-840c-40cc-b297-2e0740fee367" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:49582 10.134.0.36:443 100.64.0.2:64442 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-21T15:10:20.226799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.226849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.230329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.230461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.230653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.233138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.233195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-21T15:10:20.233231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-21T15:10:20.233241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-21T15:10:20.225Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.4" "python-requests/2.32.5" "91bddb89-d1ba-45f0-a19f-972cb7c07e9d" "maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com" "10.134.0.46:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.36:35598 10.134.0.36:443 100.64.0.4:19976 maas.apps.a750dba1-756a-4c3d-b1ec-f491fcdd8f84.prod.konfluxeaas.com opendatahub.maas-api-route.1