2026-06-03T03:56:15.755023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:56:15.733Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 21 - "100.64.0.4" "python-requests/2.32.5" "0d1a4561-92d9-4520-8eb3-101f222d30b3" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:38472 10.133.0.34:443 100.64.0.4:10262 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:56:23.788561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:23.788609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:23.801815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:23.801935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:23.812697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.812739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.818698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.818838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.818954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.820660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.820726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:23.820736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:23.821984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:23.822057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:56:23.822066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:56:23.811Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.132.0.29" "Go-http-client/1.1" "464bc360-3697-4253-873c-51593a5c352b" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39640 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-03T03:56:23.787Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 34 - "100.64.0.4" "python-requests/2.32.5" "79cd78ad-c47b-4a51-bceb-72abba1e16d4" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:38472 10.133.0.34:443 100.64.0.4:33562 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:56:37.886588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.886636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.899841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.899968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.900208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.906781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.906839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:37.906850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.927522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.927556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.935971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.936088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.936251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.939732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:37.939785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:37.939796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:56:37.885Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 21 - "100.64.0.3" "python-requests/2.32.5" "9e64426e-9bc4-4c65-9e65-0dbbc3be9e64" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:3870 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:56:37.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 13 - "100.64.0.3" "python-requests/2.32.5" "d2549e86-016c-4055-880e-7d8101125ecc" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:27054 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:56:45.965492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.965539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.969533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.969650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.971965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.972024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.978048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.978164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.978256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.979946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.980022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:45.980033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.981154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.981202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:45.981212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:45.999824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:45.999860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:46.002565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:46.002666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:46.004683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.004716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.010464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.010572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.010658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.012080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.012124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:56:46.012134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:56:46.013202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:56:46.013254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:56:46.013265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:56:45.971Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.132.0.29" "Go-http-client/1.1" "1782e0ee-9ec7-409c-b190-0ed27ecc4140" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39640 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-03T03:56:45.964Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 17 - "100.64.0.2" "python-requests/2.32.5" "2fdd57fd-f5f9-4ba7-97a0-64e85e5ad834" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.2:15264 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:56:46.003Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 8 - "10.132.0.29" "Go-http-client/1.1" "2ce795df-7653-42e2-b211-4c07960815cc" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:45534 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-03T03:56:45.998Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 14 - "100.64.0.4" "python-requests/2.32.5" "2775c1ee-ab1d-4f09-9e83-d30d3764a77d" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:38472 10.133.0.34:443 100.64.0.4:29128 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:57:04.525593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.525641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.538146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.538279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.540844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.540877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.549512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.549625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.551191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.551246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:04.551258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.552773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.552804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.560529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.560633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.562123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.562170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:04.562180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.563592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.563622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.571093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.571202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.572685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.572730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:04.572739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.573815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:04.573869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:04.573881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.3:12422 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.3:12406 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.4:5388 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.2:62502 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.2:62518 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.4:5392 - - [2026-06-03T03:57:04.501Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:443 100.64.0.2:62534 - - [2026-06-03T03:57:04.539Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.132.0.29" "Go-http-client/1.1" "5c671e2c-2703-4214-bc09-83d4f2676650" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39640 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-03T03:57:04.551Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.132.0.29" "Go-http-client/1.1" "4983368b-0a1c-4a73-874d-60f0373deb14" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:45534 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-03T03:57:04.562Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.29" "Go-http-client/1.1" "dfabd8b9-a525-4616-878e-e605b12efc25" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:57:04.524Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 49 - "100.64.0.3" "python-requests/2.32.5" "94613404-b793-432e-9227-c50ce84cceeb" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:30924 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:57:23.024577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.024625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.038647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.038780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.041627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.041671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.050020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.050138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.051820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.051877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:23.051894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.053033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.053082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:23.053092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.075072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:23.075109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:23.083399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:23.083506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:23.086407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.086439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.094085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.094189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.095738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.095789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:23.095799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:23.096916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:23.096968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:57:23.096979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:57:23.040Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.132.0.29" "Go-http-client/1.1" "f34ef8ce-ebdc-4e76-b55a-afed496115fc" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:39640 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-03T03:57:23.023Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 29 - "100.64.0.4" "python-requests/2.32.5" "d84aff99-e3a9-4bb5-93dd-6198c68cbeae" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.4:48286 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:57:23.085Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.132.0.29" "Go-http-client/1.1" "0b2af35c-6cea-4f85-b809-595713ae9892" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:45534 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-03T03:57:23.073Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 23 - "100.64.0.2" "python-requests/2.32.5" "7b75955d-b074-46eb-807a-433ee47a2693" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:38472 10.133.0.34:443 100.64.0.2:49082 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:57:31.036Z] "- - HTTP/1.1" 400 DPE http1.codec_error - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:80 100.64.0.3:42752 - - 2026-06-03T03:57:32.097119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:32.097166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:32.098631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:32.098665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:57:32.095Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "59ed7aa3-f647-43ff-90b1-46140068b005" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.34:443 100.64.0.4:18676 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:57:48.683508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.683555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.698497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.698618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.698818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.703185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.703241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:57:48.703252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.722503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.722535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.729436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.729551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.729776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.729804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.731132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.731156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.731361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.733714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.733839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.734038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.734646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:57:48.753684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.753719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.759983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.760127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.760361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.760392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.760958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.760982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.781205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.781237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.787332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.787445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.787665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.787693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.788191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.788214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.804518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.804550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.807418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.807509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.809933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.809969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.816068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.816182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.816273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.817883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.817931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:48.817942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.819301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:57:48.819347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:57:48.819357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:57:48.682Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 21 - "100.64.0.3" "python-requests/2.32.5" "b83ae0ed-5f1f-4359-a35c-f45b76b370c2" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:38472 10.133.0.34:443 100.64.0.3:6778 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:57:48.722Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 12 - "100.64.0.2" "python-requests/2.32.5" "55c48f7d-210f-4f16-a986-019e7cc288d6" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:40404 10.133.0.34:443 100.64.0.2:46070 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T03:57:48.753Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.4" "python-requests/2.32.5" "f039ab4e-c138-4e51-bef9-c03d642b9a73" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:33224 10.133.0.34:443 100.64.0.4:60890 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T03:57:48.780Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "30b56335-d488-42d1-8ca1-cdae04f5eab1" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.34:443 100.64.0.3:34574 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T03:57:48.809Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "a1c9f6cc-fd75-4188-96b4-7b0e7aa1a631" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:41122 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:57:48.803Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 15 - "100.64.0.3" "python-requests/2.32.5" "0e6b9d6f-9289-474a-acf3-b89328d0b88e" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:6786 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:57:57.638446Z info ads ADS: new connection for node:6 2026-06-03T03:57:57.643234Z info cache read certificate from file resource=file-root:system 2026-06-03T03:58:04.373080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.373137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.386894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.387086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.387325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.391582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.391650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:58:04.391667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:58:04.371Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 19 - "100.64.0.2" "python-requests/2.32.5" "f5129420-5c24-4e94-9a1c-d36681303bec" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.2:21872 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:58:04.727723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.727770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.728714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.728748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.747385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.747423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.748293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.748329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:58:04.770135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.770166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.776682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.776799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.777062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.777091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.778653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.778676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.778892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.779901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:58:04.780042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:58:04.780054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:58:04.726Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "0b6259a6-ac4c-40e1-8724-f41b1ffad9f5" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.34:443 100.64.0.4:59730 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-03T03:58:04.746Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "feecac91-535a-4b5c-9acc-84b6a824da35" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.34:443 100.64.0.2:31196 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-03T03:58:04.769Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 10 - "100.64.0.4" "python-requests/2.32.5" "e6eff6cc-d32a-4a3a-89c6-3d0c9cf61279" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.34:443 100.64.0.4:54514 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-03T03:58:19.601Z] "- - HTTP/1.1" 426 DPE low_version - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.34:80 100.64.0.2:29342 - - 2026-06-03T03:58:42.422316Z info ads ADS: "" 6 terminated with stream closed 2026-06-03T03:59:04.225159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.225206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.228572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.228703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.228912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.243972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.244068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:04.244081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:04.394953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.395032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:59:04.223Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 20 - "100.64.0.3" "python-requests/2.32.5" "57baf763-bfb3-43b2-9551-bff3f0aad1b6" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:24700 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:59:04.426307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.426359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.445264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.445312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.446594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.446633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.467941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.467984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.469192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:04.469228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.089868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.089918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.092556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.092676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.092883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.098804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.098864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:05.098875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:59:04.393Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 32 - "100.64.0.3" "python-requests/2.32.5" "b989dff5-2c6f-4603-a4af-fac885cd6824" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.34:443 100.64.0.3:10676 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:04.444Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 2 - "100.64.0.2" "python-requests/2.32.5" "08983a08-5766-4d5f-9324-45b436ac3299" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.34:443 100.64.0.2:1030 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:04.466Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.4" "python-requests/2.32.5" "c741ddad-5947-421e-9648-d53540da35d8" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.34:443 100.64.0.4:21406 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:05.088Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 10 - "100.64.0.3" "python-requests/2.32.5" "f7e047bb-e0f9-452a-8552-42cc7216b246" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.3:10692 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:59:05.483084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.483127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.485663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.485775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.485971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.489601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.489657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:05.489667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.509842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.509876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.521527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.521619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.524365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.524411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.530591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.530729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.530831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.533409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.533461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:05.533472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.534902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.534955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:05.534967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.553588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.553636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.560642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.560837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.561181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.561221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.562675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.562702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.562901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.564654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.564780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.564954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.565403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:05.707934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.707970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.710322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.710424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.710589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.713922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.713969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:05.713979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.733642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.733673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.735865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.735958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.740346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:05.740393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:05.740402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T03:59:05.481Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.2" "python-requests/2.32.5" "d017bb74-6f51-4bef-b209-3afd2c764935" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.2:23994 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:05.523Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.29" "Go-http-client/1.1" "0439e833-b91f-41d9-b22e-89f6a034fc92" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:59:05.508Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 26 - "100.64.0.2" "python-requests/2.32.5" "fcc26b19-f45b-4346-8207-b7f5544e3518" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.2:1038 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:05.552Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 360 12 - "100.64.0.4" "python-requests/2.32.5" "1485f7b7-4d9f-45c1-868d-c9a6176f75f8" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 100.64.0.4:2008 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-03T03:59:05.706Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "0a82761e-5efb-40b0-9745-aef862f5a414" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.4:21418 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:05.732Z] "DELETE /v1/api-keys/37bf07d5-f6a8-4689-b918-2d724934bc03 HTTP/1.1" 200 - via_upstream - "-" 0 251 7 - "100.64.0.3" "python-requests/2.32.5" "a7bbefa4-23a2-41d9-8821-30862a7b76e6" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.3:24702 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:59:08.764038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.764083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.768692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.768774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.770608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.770664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:08.770674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:08.940546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:08.940588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:08.953695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:08.953731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.219823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.219868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.222507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.222621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.222810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.226412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.226470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.226481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.242666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.242707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.245052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.245162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.245332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.248923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.248974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:09.248984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.380477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.380518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.383135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.383250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.383436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.386861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.386913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.386923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.403496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.403529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:59:08.762Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.3" "python-requests/2.32.5" "a63ffed4-0043-4e58-89bc-3f5e34b13629" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:10696 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:08.939Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 14 - "100.64.0.2" "python-requests/2.32.5" "f5bb1af6-d8de-9421-8def-3eaf9ffff996" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.34:443 100.64.0.2:1042 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.218Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 8 - "100.64.0.4" "python-requests/2.32.5" "a4d09a94-6bf2-4953-b6de-4c97b346db39" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.4:21426 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.241Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 316 7 - "100.64.0.3" "python-requests/2.32.5" "a214b8a3-61e8-4ee5-bcfa-6aedcc102152" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.3:10706 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.379Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 7 - "100.64.0.2" "python-requests/2.32.5" "85a5defe-5c7e-4054-8562-cad2830716f0" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.2:28304 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-03T03:59:09.405811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.405909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.409702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.409749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.409760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.425665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.425699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.427852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.427943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.430233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.430276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.430286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.565314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.565349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.567560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.567666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.567823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.571102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.571150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.571160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.588325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.588360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.591504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.591606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.593697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.593729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.599879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.600032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.600123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.601607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.601661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.601671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.602778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.602831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:09.602842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.735344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.735385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.737898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.738028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.738200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.741557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.741608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:09.741618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.758261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.758297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.761472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.761574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.763155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.763200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.763210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.778135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.778166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.781047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.781138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.783143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.783178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.789057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.789189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.789280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.790772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.790817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.790828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.791815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.791862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.791872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.927810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.927844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.930230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.930322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.930470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.934030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.934076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.934086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.950187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.950220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.953269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.953377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.955453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.955484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.961167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.961298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.961389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.962967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.963038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.963050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.964189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.964240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:09.964252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.979048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.979083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.981847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.981945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.983921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.983952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.989570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.989695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.989804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.991307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.991352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:09.991362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:09.992508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:09.992563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T03:59:09.992575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T03:59:10.125567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.125606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.128089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.128189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.128349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.131712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T03:59:10.131762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T03:59:10.131773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T03:59:09.402Z] "DELETE /v1/api-keys/f70e5302-45f8-4e2a-bb8c-41b2bd9d4ac4 HTTP/1.1" 200 - via_upstream - "-" 0 253 7 - "100.64.0.4" "python-requests/2.32.5" "d4b688bd-e984-48f7-b7a2-c9313b7979d0" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.4:28746 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.424Z] "DELETE /v1/api-keys/f70e5302-45f8-4e2a-bb8c-41b2bd9d4ac4 HTTP/1.1" 404 - via_upstream - "-" 0 29 5 - "100.64.0.2" "python-requests/2.32.5" "144660a8-89c7-4e8d-9ed3-c02aea37a745" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.2:24008 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.564Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 6 - "100.64.0.4" "python-requests/2.32.5" "fc3e9f7c-b703-4d9a-9d6f-3a8b45d8153a" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.4:2010 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.592Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "ed873178-a199-43f9-ac65-23389f9a9593" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:59:09.587Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "444b62ee-c4f9-4c5d-96c9-b2a10a8a8e52" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.3:24712 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.734Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.3" "python-requests/2.32.5" "005d07b2-b365-4a38-9fdc-a63f7b171446" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.3:33646 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.757Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.2" "python-requests/2.32.5" "7f9dee27-32a0-47d9-9455-46676b73cea1" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.2:28306 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.782Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "8820e07c-bac1-4421-a49d-2e2da8f82f25" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:59:09.777Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "80885cc9-2f34-4791-9e6c-3ee33585f327" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.4:28750 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "538ae114-7cc4-436e-86a2-8bf78c36b951" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:33652 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.954Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "2cbe8c4f-318c-4922-99d3-df9006890c06" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:59:09.949Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.2" "python-requests/2.32.5" "b419c9c7-ed7a-47f8-939a-a2e017c769de" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.2:24010 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:09.983Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "371d3a8c-760d-4142-9c2f-111dd7ec00d3" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.34:52992 10.133.0.34:443 10.132.0.29:36390 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-03T03:59:09.978Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "14457991-0755-46b2-a86d-9a6dbdb0dcc8" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:35832 10.133.0.34:443 100.64.0.4:2016 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-03T03:59:10.124Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.3" "python-requests/2.32.5" "7c927f2d-14dc-48ee-a137-cd901502c8b9" "maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.34:42560 10.133.0.34:443 100.64.0.3:24724 maas.apps.6ac44bd0-7c06-4c47-b5c4-8d427929f69b.prod.konfluxeaas.com opendatahub.maas-api-route.1