2026-04-20T15:26:51.245236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.245286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.269491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.269531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.296581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.296626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.298018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.298052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.320463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.320500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.321794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.321823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:51.991976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.992025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.995355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.995475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.995631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.996113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.996163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:26:51.996194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:26:51.996203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:26:51.244Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 25 - "100.64.0.4" "python-requests/2.32.5" "ea78a81e-97c6-4620-b574-c41156d7cd21" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.36:443 100.64.0.4:43102 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:26:51.295Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 2 - "100.64.0.3" "python-requests/2.32.5" "f743d84e-6e6c-4600-91ff-ec4b8e110b55" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.36:443 100.64.0.3:37998 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:26:51.319Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.4" "python-requests/2.32.5" "cf926c88-61c3-4d3b-a00e-926ec07338dd" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.36:443 100.64.0.4:3064 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:26:51.990Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 28 96 5 - "100.64.0.2" "python-requests/2.32.5" "ea132eeb-b579-4415-b1d5-6ce7b9c3d586" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:38562 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:26:57.019225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.019277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:26:57.023865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:26:57.023874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:26:57.018Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 28 96 5 - "100.64.0.3" "python-requests/2.32.5" "d72155cc-93bf-4395-a3ca-69a865660250" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:12912 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:02.050871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.050924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.054385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.054520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.054688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.055174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.055225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:02.055257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:02.055266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:02.049Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 28 96 5 - "100.64.0.4" "python-requests/2.32.5" "135b0ba5-7b62-4b24-bd05-59247a41ebe6" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:57328 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:07.083871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.083921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.088064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.088229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.088485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.089032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.089083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:07.089115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:07.089124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:07.082Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 28 96 6 - "100.64.0.2" "python-requests/2.32.5" "fafaa749-175e-465d-a042-1d9ade870c8f" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:14266 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:12.118872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.118923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.122394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.122515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.122669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.123107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.123152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:12.123181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:12.123189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:12.117Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 28 96 5 - "100.64.0.3" "python-requests/2.32.5" "00512cfa-85ed-4bdc-accd-5653099aa4a3" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:26642 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:27:14.236Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 35 - "-" "-" "-" "-" "-" - - 10.133.0.36:443 100.64.0.4:54562 n-use1-device-sur.i.tplinkcloud.com - 2026-04-20T15:27:17.152624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.152674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.156003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.156120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.156275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.160205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.160259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.160290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:17.160317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:17.151Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 8 - "100.64.0.2" "python-requests/2.32.5" "505962a9-814e-4ffb-a6e7-b9a613ee9c6d" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:28888 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:17.552639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.552689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:17.556980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:17.556989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:17.551Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "a8b020b7-78fa-4be9-aa13-29f2d574ca72" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:3004 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:22.584426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.584482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.588020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.588206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.588488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.589036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.589104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:22.589155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:22.589170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:22.583Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.4" "python-requests/2.32.5" "176e7cf4-e1e8-4961-ada5-1a1d1d997904" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:34142 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:27.620807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.620858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:27.624975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:27.624984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:27.619Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "b81c93ec-74cd-4ffa-8aaf-71634dc987be" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:42114 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:32.659255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.659328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:32.663900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:32.663909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:32.658Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "e4ffa4e0-9d14-4d0f-a0fa-8f83ddadcfe2" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:31608 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:37.694906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.694966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.698743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.698880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.699056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.699560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.699617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:37.699659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:37.699673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:37.693Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "ec390798-51ac-4d34-bd37-d521f10b0093" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:41910 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:42.729460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.729509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.733993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:42.734001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:42.921973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.922035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.925551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.925698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.925886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.926410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.926472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:42.926524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:42.926538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:42.728Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "70de8527-8caa-45da-962f-7774b8acadaa" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:48498 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:27:42.920Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "08ef322d-bd9a-49cb-a67e-72f78c9cf080" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:30142 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:47.952084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.952138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.955445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.955559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.955712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.956151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.956194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:27:47.956222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:27:47.956231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:27:47.950Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "21592650-475d-4bfb-a5cb-f3242cfa473d" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:47234 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:52.987448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.987499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.991103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.991238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.991432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.993827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.993894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:52.993929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:52.993938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.018936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.018980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.022004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.022113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.026098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.026153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:53.026185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:53.026194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:52.986Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.2" "python-requests/2.32.5" "cba28a6b-c6ad-4488-9360-6712fa57e42f" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:31946 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:27:53.017Z] "DELETE /v1/api-keys/b92ade70-4829-46a8-8693-2a3cc7cace18 HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.2" "python-requests/2.32.5" "a50cac04-73cb-4442-8cb3-7a5ec6a16582" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:26728 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:56.050386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.050434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.064546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.064582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:56.049Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 15 - "100.64.0.3" "python-requests/2.32.5" "49868238-b3f5-482d-8f2d-f2c3372c470f" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.36:443 100.64.0.3:34272 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:27:56.244334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.244385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.265562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.265603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.529105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.529157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.532537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.532653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.532812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.533343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.533395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:27:56.533426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:27:56.533435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:27:56.243Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 22 - "100.64.0.3" "python-requests/2.32.5" "9bb20a8d-632b-401f-83b3-0a428ee8398c" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.36:443 100.64.0.3:26196 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:27:56.528Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 34 96 5 - "100.64.0.4" "python-requests/2.32.5" "5cfaa0a2-e03c-4f82-882f-2b352095c8ed" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:40458 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:01.576508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.576560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.580106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.580284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.580508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.582934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.582990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.583025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:01.583034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:01.639728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.639778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.642832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.642968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.643149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.643655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.643707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:01.643740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:01.643749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:01.575Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 7 - "100.64.0.4" "python-requests/2.32.5" "1bd5dcfc-0df9-4b58-a0e1-a67af9cd16cd" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:48486 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:01.638Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.2" "python-requests/2.32.5" "082bfb71-85d7-49b1-b1ab-8d33c1b94078" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:13840 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:06.671073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.671125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.674614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.674738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.674898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.675428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.675476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:06.675512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:06.675521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:06.670Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.3" "python-requests/2.32.5" "859a0d28-df15-4608-810a-51a516f4807f" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:10376 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:11.701827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.701885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.705296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.705446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.705604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.706073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.706118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:11.706149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:11.706158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:11.700Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.4" "python-requests/2.32.5" "ec48cf01-5d8e-4bd4-93d4-49f3355c59ad" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:1988 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:16.738962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.739011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.742456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.742603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.742778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.743214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.743270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:16.743335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:16.743349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:16.737Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.2" "python-requests/2.32.5" "a7e66143-2441-4890-9c5b-8a40aecec7b5" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:46108 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:21.776371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.776422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.779835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.779958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.780119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.780617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.780667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:21.780698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:21.780707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:21.775Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.3" "python-requests/2.32.5" "6c6ebdb3-1648-4833-b462-d6d120f11413" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:43100 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:26.810652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.810705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.814554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.814683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.814852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.815359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.815408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.815441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:26.815450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:26.976677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.976736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.980324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.980490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.980703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.989629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.989695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:26.989730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:26.989740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.012178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.012224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.016106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.016225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.016784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.016837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.016868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:27.016877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:27.175765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.175813Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.179872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.179986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.180138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.180596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.180647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:27.180687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:27.180701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:26.809Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 32 96 5 - "100.64.0.4" "python-requests/2.32.5" "21375905-ae16-41cd-8400-3011321eb910" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:18600 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:26.975Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 14 - "100.64.0.2" "python-requests/2.32.5" "0c8ae3a6-7381-4810-a737-5614b87a571c" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:17926 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:27.011Z] "DELETE /v1/api-keys/0035dd88-ca57-4588-99c7-47e466a63d36 HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.2" "python-requests/2.32.5" "23718ebc-95a7-408f-8661-371df014afc9" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:8090 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:27.174Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 6 - "100.64.0.3" "python-requests/2.32.5" "9835f76e-485e-46fb-8440-e4fe3eb81fbf" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:55306 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:32.205543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.205603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.209296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.209473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.209660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.212098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.212164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.212207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:32.212221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.233701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.233748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.238059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.238186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.250470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.250511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.257374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.257506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.257620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.258284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.258352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.258388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:32.258398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.259420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.259464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:32.259498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:32.259508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:32.204Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "006e54eb-4278-450e-bbad-a6a9f62db74f" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:14358 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:32.249Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "7438392d-d6a4-4628-bf5e-286fe939116b" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:37598 10.133.0.36:443 100.64.0.2:5020 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-20T15:28:32.232Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 26 - "100.64.0.4" "python-requests/2.32.5" "c9459952-10c8-4728-ac9a-4848e0a98f3d" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:4184 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:32.404786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.404835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.408233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.408364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.408521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.408988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.409033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:32.409062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:32.409071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:32.403Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "458ce524-a744-4540-88c2-b2094c6237b8" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:63548 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:37.435805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.435857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.439612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.439762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.439957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.440482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.440538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:37.440572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:37.440581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:37.434Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.2" "python-requests/2.32.5" "1adae5b9-5fc5-44e2-ba44-7d411cc56ab3" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:10496 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:41.699Z] "- - HTTP/1.1" 426 DPE low_version - "-" 0 16 0 - "-" "-" "-" "-" "-" - - 10.133.0.36:80 100.64.0.4:6032 - - 2026-04-20T15:28:42.472271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.472353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.475924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.476078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.476261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.476772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.476833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:42.476873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:42.476886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:42.471Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "82b48f79-4079-4fbc-92a6-9bfa3dac8679" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:10868 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:47.522766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.522817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.526205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.526359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.526558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.527035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.527092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:47.527137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:47.527151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:47.521Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.3" "python-requests/2.32.5" "9b9faebd-84fc-4dfd-8256-d6e582eacc26" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:16246 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:52.558533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.558585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.561968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.562088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.562252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.562779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.562921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:52.562971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:52.562989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:28:52.557Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 29 96 5 - "100.64.0.4" "python-requests/2.32.5" "1f61e6df-db2c-4590-985c-f9ac3f622b86" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:37658 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:28:57.605030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.605092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.608478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.608611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.608781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.611032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.611090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.611132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:57.611145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.632135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.632178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.636728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.636880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.637456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.637515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.637555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:57.637568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.659237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.659277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.663611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.663720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.665502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.665542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.673054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.673193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.673330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.673925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.673977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.674018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:57.674031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.675058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.675111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.675147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:57.675157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.821234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.821292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.824564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.824698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.824882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.826919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.826983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.827027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:57.827041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.845021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.845067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.849197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.849352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.851160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.851195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.857537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.857667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.857770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.858411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.858458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.858491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:57.858500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.859491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.859535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.859568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:57.859577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.884199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.884244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.888048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.888164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.889886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.889922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.896153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.896272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.896397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.896941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.896988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.897018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:57.897027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:57.897870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.897917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:57.897954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:28:57.897963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:28:58.043657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.043719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:28:58.047949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:28:58.047963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:28:57.603Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.2" "python-requests/2.32.5" "5dc7f70f-dc1f-41ff-bed7-8473c544c0e7" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:32848 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:57.631Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.3" "python-requests/2.32.5" "8d5abf2b-7d0f-4bcb-bea6-3b75ef28efdf" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:3718 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:57.664Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "100.64.0.2" "Go-http-client/1.1" "f5eb17ad-f415-42f4-a999-6367d1e6ff06" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:37598 10.133.0.36:443 100.64.0.2:5020 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-20T15:28:57.658Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.4" "python-requests/2.32.5" "90590cdf-8e28-42f7-9a86-7a83471aafa2" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:39236 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:57.820Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 6 - "100.64.0.2" "python-requests/2.32.5" "a8ba444e-2e05-4a94-9b0a-2c1ecf432f58" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.2:55550 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:57.850Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "16cabcb6-3875-47f5-990c-e98d71d01284" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:37598 10.133.0.36:443 100.64.0.2:5020 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-20T15:28:57.844Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "1ecb386d-f56e-477c-81bf-038c73cd0352" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.3:58458 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:57.889Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.2" "Go-http-client/1.1" "d6f3dc87-2e0f-4778-82b6-bda2ca33298d" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.134.0.55:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.36:37598 10.133.0.36:443 100.64.0.2:5020 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-20T15:28:57.883Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "6b2de0c4-6280-4983-bf8f-79e9dee6358a" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.4:37664 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-20T15:28:58.042Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 36 96 5 - "100.64.0.4" "python-requests/2.32.5" "f80cfbbf-d630-4a5a-9e36-fc7658bce601" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:39242 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:29:03.078838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.078888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.082227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.082382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.082571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.083067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.083116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:03.083149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:29:03.083160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:29:03.077Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 36 96 5 - "100.64.0.2" "python-requests/2.32.5" "15179cab-0e29-4a9b-8d77-2bcd89465f1c" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.2:54802 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:29:08.109775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.109827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.113567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.113691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.113852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.114293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.114357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-20T15:29:08.114387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-20T15:29:08.114396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-20T15:29:08.108Z] "POST /v1/api-keys HTTP/1.1" 500 - via_upstream - "-" 36 96 5 - "100.64.0.3" "python-requests/2.32.5" "3aa5388f-08d0-46be-8154-c65ee56cbfc1" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:60118 10.133.0.36:443 100.64.0.3:64448 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-20T15:29:13.145866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.145918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.149529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.149664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.149833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.151997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.152049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-20T15:29:13.152082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-20T15:29:13.152091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-20T15:29:13.144Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.4" "python-requests/2.32.5" "aa46226f-dac5-4e9f-ba8b-447a8f9f7f9b" "maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com" "10.133.0.39:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.36:57288 10.133.0.36:443 100.64.0.4:45416 maas.apps.04faa770-22fb-475a-b4e9-f5a176fc4161.prod.konfluxeaas.com opendatahub.maas-api-route.1