2026-06-09T22:21:35.929292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:21:35.912Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 16 - "100.64.0.4" "python-requests/2.32.5" "6545d3d9-48a8-441b-a9b5-1cfd853c9be7" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.4:26806 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:21:47.816432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.816477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.828654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.828765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.828947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.833073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:47.833131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:21:47.833141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:21:47.814Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 18 - "100.64.0.2" "python-requests/2.32.5" "91600262-4574-4f86-a4b3-e4a44d9085bc" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.2:12842 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:21:55.864090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.864138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.877719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.877847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.888499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.888537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.894243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.894397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.894500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.896101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.896168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:21:55.896179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.897282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:21:55.897358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:21:55.897370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:21:55.887Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.132.0.40" "Go-http-client/1.1" "cd714604-739c-4d1b-a6af-ce12d67aecd9" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:42262 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-09T22:21:55.862Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 34 - "100.64.0.3" "python-requests/2.32.5" "97e0e6d3-7a22-4985-b6e5-b82d85249b13" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.3:50166 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:22:07.893175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.893222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.906593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.906703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.906882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.910803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.910861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:07.910872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:07.928149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.928188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.936862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.936965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.937136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.940326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:07.940403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:22:07.940415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:22:07.891Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 19 - "100.64.0.4" "python-requests/2.32.5" "0a9003d3-ccca-4aff-baf8-570115d7cd9a" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.4:63588 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:22:07.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 13 - "100.64.0.2" "python-requests/2.32.5" "5079dd93-8ad9-4e77-82f2-06498d1a223b" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.2:27216 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:22:15.971071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.971118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.974824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.974931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.977618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.977650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.983601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.983708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.983804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.985611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.985667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:15.985678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.986869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:15.986915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:15.986925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.013112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.013146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.015780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.015869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.017941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.017974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.023475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.023581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.023677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.026092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.026143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:16.026153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.027278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:16.027328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:16.027362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:22:15.976Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.132.0.40" "Go-http-client/1.1" "a1b1019e-9168-4580-989d-af642e2e12aa" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:42262 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-09T22:22:15.969Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 17 - "100.64.0.3" "python-requests/2.32.5" "223b97c0-8084-41d1-9418-1710fb4f7eef" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.3:14420 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:22:16.017Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "10.132.0.40" "Go-http-client/1.1" "94ef64b8-05d6-45cd-9843-0cdba63b7b1f" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:56314 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-09T22:22:16.011Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 15 - "100.64.0.3" "python-requests/2.32.5" "55b232d2-1183-4a4e-bf7a-0eaec6a4d7e6" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.3:10562 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:22:32.426605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:32.426651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:32.439004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:32.439118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:32.442076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.442122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.450315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.450448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.452109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.452167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:32.452178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.453693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.453724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.462116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.462213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.463663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.463713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:32.463724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.465070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.465100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.472443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.472539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.474906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.474953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:32.474963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:32.476011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:32.476074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:22:32.476087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:22:32.440Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.132.0.40" "Go-http-client/1.1" "4e5fcef8-6335-4002-9c48-6c5e88872c6b" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:42262 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-09T22:22:32.452Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.132.0.40" "Go-http-client/1.1" "729a790f-d7a3-4e95-930f-0cdb934c0f29" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:56314 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-09T22:22:32.464Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.40" "Go-http-client/1.1" "62aba195-ec4c-40d3-afe2-a3a49675c504" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:22:32.425Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 50 - "100.64.0.4" "python-requests/2.32.5" "02bd0857-badf-4514-9612-c3934412649f" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.4:23002 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:22:46.793788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.793839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.807179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.807309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.811580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.811625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.820778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.820914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.822761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.822826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:46.822838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.824470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.824526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:22:46.824538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:46.843952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.843991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.852791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.852889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.855153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.855187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.863638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.863737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.865982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.866040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:46.866050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.867213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:22:46.867260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:22:46.867270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:22:46.810Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.132.0.40" "Go-http-client/1.1" "b647605b-b59a-4f0b-ab3d-875c6c891ce9" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:42262 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-09T22:22:46.791Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 32 - "100.64.0.4" "python-requests/2.32.5" "99d1a238-7071-4801-bb23-b35a12c16544" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.4:21810 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:22:46.854Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.132.0.40" "Go-http-client/1.1" "634c7eec-661b-4be9-b8a0-12a8247e5cf0" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:56314 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-09T22:22:46.842Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 24 - "100.64.0.2" "python-requests/2.32.5" "39a394ad-3d47-4342-8a5d-e7bc155db439" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:39368 10.134.0.29:443 100.64.0.2:24334 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:22:55.873107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:55.873170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:55.874905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:22:55.874955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:22:55.871Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 3 - "100.64.0.3" "python-requests/2.32.5" "d9fa33bb-6817-4817-b7ff-f9f99a543c36" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.29:443 100.64.0.3:57800 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:23:12.492116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.492164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.507497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.507619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.507812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.514055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.514122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:23:12.514134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.541468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.541505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.548993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.549116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.549374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.549405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.550750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.550773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.550961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.552654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.552776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.552935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.553643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.573357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.573390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.580400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.580510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.580732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.580761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.581253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.581276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.598937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.598971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.604742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.604851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.605076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.605107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.605509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.605533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.625591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.625624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.628286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.628398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.630963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.630997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.636627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.636732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.636821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.638089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.638148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:23:12.638160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:12.639240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:12.639292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:23:12.639304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:23:12.490Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 23 - "100.64.0.4" "python-requests/2.32.5" "4309a9cd-778f-4964-a81d-a62a4769f061" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.4:40726 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:23:12.540Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 13 - "100.64.0.2" "python-requests/2.32.5" "25ea7544-e80b-48b4-b7db-63c3bcab4d50" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:44420 10.134.0.29:443 100.64.0.2:43856 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-09T22:23:12.572Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 9 - "100.64.0.3" "python-requests/2.32.5" "cf091532-2115-4b49-a6bc-5c5424114d8d" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:44432 10.134.0.29:443 100.64.0.3:20178 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-09T22:23:12.597Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "d02047dd-f1b2-4a36-8c36-45b1176bad3d" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.29:443 100.64.0.2:53984 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-09T22:23:12.630Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.40" "Go-http-client/1.1" "02dc48b0-d2e4-415a-8c24-e109dd37ffb4" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:44420 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:23:12.624Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 14 - "100.64.0.4" "python-requests/2.32.5" "818018ff-440f-4f5b-a46c-9b92b4f16632" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.4:56080 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:23:21.531297Z info ads ADS: new connection for node:6 2026-06-09T22:23:21.533469Z info cache read certificate from file resource=file-root:system 2026-06-09T22:23:26.145483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.145529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.158101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.158206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.158407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.162849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.162906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:23:26.162917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.500903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.500944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.502032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.502062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:23:26.524522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.524562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.525515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.525547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.544621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.544657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.551527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.551637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.551860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.551888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.553533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.553558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.553748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.554721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:23:26.554825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:23:26.554836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:23:26.143Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 19 - "100.64.0.3" "python-requests/2.32.5" "a3f366e1-6c0e-4377-a91e-a6916f355dbe" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:49200 10.134.0.29:443 100.64.0.3:5788 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:23:26.499Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "eef48ae6-1cc7-47d0-8556-48621af01c1a" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.29:443 100.64.0.4:30734 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-09T22:23:26.523Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "294e0f36-5867-4262-9ba4-96bb67065993" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.29:443 100.64.0.2:57786 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-09T22:23:26.543Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 11 - "100.64.0.2" "python-requests/2.32.5" "217498fd-c903-49a0-9326-a87e7d29f12b" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.29:443 100.64.0.2:15114 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-09T22:24:04.101971Z info ads ADS: "" 6 terminated with stream closed 2026-06-09T22:24:31.672015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.672063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.674973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.675082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.675247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.690081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.690150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:31.690161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.775932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.775975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.808540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.808580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.832169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:31.832211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:31.833480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:31.833512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:31.856359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.856393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.857536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:31.857565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:24:31.670Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 19 - "100.64.0.3" "python-requests/2.32.5" "6754e490-6b64-410b-80c4-393e300432ae" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.3:16924 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:31.774Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 34 - "100.64.0.4" "python-requests/2.32.5" "8858dbe9-42af-4a71-bbc8-4a29a19ed273" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.29:443 100.64.0.4:5642 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:31.830Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 2 - "100.64.0.2" "python-requests/2.32.5" "41cb0380-5347-4259-bbd6-36a7d9ee3255" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.29:443 100.64.0.2:54022 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:31.855Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.3" "python-requests/2.32.5" "6b5edd81-116e-4a47-b73e-36170f6bd590" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.29:443 100.64.0.3:16838 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:24:32.195707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.195754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.198358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.198459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.198629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.203230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.203289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:32.203300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.392715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.392758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.395493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.395593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.395757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.399117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.399174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:32.399184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.415140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.415179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.427330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.427463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.429560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.429593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.435306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.435454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.435544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.437563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.437620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:32.437631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.438847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.438899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:32.438910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.455446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.455477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.461511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.461625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.461835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.461864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.463169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.463191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.463400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.464941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.465066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.465227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.465715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.554511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.554550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.557375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.557469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.557625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.560966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.561030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:32.561041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:32.578104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.578141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.580478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.580575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.584484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:32.584537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:32.584548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-09T22:24:32.194Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 9 - "100.64.0.3" "python-requests/2.32.5" "2272a24e-6969-41fb-bee3-3ae508d8dcfc" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.3:16932 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:32.391Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.4" "python-requests/2.32.5" "dd98dc88-0aef-4a32-9617-338b266d3dd2" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:5658 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:32.428Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.40" "Go-http-client/1.1" "dcf3d443-e39a-435a-88e3-ad32a55a36f2" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:24:32.413Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 25 - "100.64.0.2" "python-requests/2.32.5" "a0ce2a7a-0cbf-4059-9e0d-1f22eb14ab34" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.2:54024 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:32.454Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 338 11 - "100.64.0.3" "python-requests/2.32.5" "20cba44c-0efa-4937-95bd-4cc3a35ebb43" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 100.64.0.3:16934 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-09T22:24:32.553Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "7d5a0bbf-b840-469a-965d-be7bd2d3c674" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:5672 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:32.576Z] "DELETE /v1/api-keys/b9d9e2b7-ebb6-40f5-87ad-184674b80368 HTTP/1.1" 200 - via_upstream - "-" 0 251 7 - "100.64.0.2" "python-requests/2.32.5" "a0330ab5-bfe3-4b9b-8d91-7f79628e9b0e" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.2:54030 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:24:35.607833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.607881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.611530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.611599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.613432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.613489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:35.613500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.732441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.732482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.745973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.746012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.884541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.884587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.887263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.887381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.887552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.890584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.890643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:35.890654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:35.906402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.906439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.908968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.909077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.909239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.912316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.912388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:35.912400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.983937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.983979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.986609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.986707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.986871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.989877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:35.989935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:35.989946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.006378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.006412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.008940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.009042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:24:35.606Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.3" "python-requests/2.32.5" "20e5daec-ff00-47af-add6-c3bb514690ca" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.3:16940 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:35.730Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 15 - "100.64.0.4" "python-requests/2.32.5" "9598dca3-5928-4a12-b665-e8232b3ea202" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.29:443 100.64.0.4:5686 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:35.882Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 7 - "100.64.0.2" "python-requests/2.32.5" "1c5f92d6-5dd0-471f-b031-66157799bcb8" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.2:54040 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:35.905Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 315 7 - "100.64.0.4" "python-requests/2.32.5" "3662caa4-bdbe-4120-b664-0ac516ed3dbf" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:9270 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:35.982Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 7 - "100.64.0.3" "python-requests/2.32.5" "f7fa2a6f-412d-41ea-ad88-41c4ff3d3555" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.3:16956 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-09T22:24:36.012389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.012442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.012452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.028012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.028042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.030186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.030273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.032158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.032211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.032222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.106323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.106385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.109072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.109169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.109359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.112436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.112492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.112503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.131118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.131151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.134059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.134149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.136184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.136218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.142057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.142178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.142270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.143618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.143672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.143682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.144636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.144688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.144698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.220778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.220819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.223494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.223590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.223752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.226879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.226941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.226953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.244009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.244045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.246929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.247023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.248461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.248511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.248522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.264106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.264140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.266841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.266928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.268764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.268796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.276706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.276825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.276908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.278244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.278295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.278305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.279533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.279586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.279601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.353800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.353839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.356802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.356902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.357076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.360246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.360298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.360309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.376203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.376243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.379083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.379176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.381192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.381224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.386998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.387117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.387203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.388506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.388558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.388569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.389606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.389657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.389668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.405815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.405848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.408466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.408554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.410499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.410530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.415845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.415958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.416041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.417300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.417374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-09T22:24:36.417385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-09T22:24:36.418411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.418458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.418469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.501069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.501103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.503554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.503641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.503783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.506831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-06-09T22:24:36.506879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-06-09T22:24:36.506889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-06-09T22:24:36.005Z] "DELETE /v1/api-keys/b44fa85c-43db-4a45-b4fa-5dd971bc184d HTTP/1.1" 200 - via_upstream - "-" 0 253 7 - "100.64.0.4" "python-requests/2.32.5" "8916169c-d1e0-4713-9a78-80fd28316683" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:5692 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.026Z] "DELETE /v1/api-keys/b44fa85c-43db-4a45-b4fa-5dd971bc184d HTTP/1.1" 404 - via_upstream - "-" 0 29 5 - "100.64.0.2" "python-requests/2.32.5" "144c5553-959c-4e8e-af2e-551ac37cb833" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.2:54052 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.104Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.2" "python-requests/2.32.5" "ca7adac2-7962-47a3-a841-93b67cbef48f" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.2:38194 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.135Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.40" "Go-http-client/1.1" "c415d537-9115-42ce-b767-348ff262b0ae" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:24:36.130Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.3" "python-requests/2.32.5" "c92b6958-4d06-4a9d-b745-ce6102d201ff" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.3:48290 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.219Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "c560ef5e-c62a-4a18-bda6-586ce4b9487c" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.3:16958 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.242Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 5 - "100.64.0.4" "python-requests/2.32.5" "caa70810-4a9b-4aeb-9e5d-8208da5b956b" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:5694 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.267Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.40" "Go-http-client/1.1" "bc311dad-1ee7-441b-9885-7b3430dd02c4" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:24:36.263Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.2" "python-requests/2.32.5" "3b38fb73-7aad-46a4-bc28-bd8e2fa106fb" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.2:54064 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.352Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.3" "python-requests/2.32.5" "493bfe71-d442-439a-8f8e-f3aef1587b7a" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54092 10.134.0.29:443 100.64.0.3:16974 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.380Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.40" "Go-http-client/1.1" "c278b337-5a96-483d-9f6a-be7ba27aabf3" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:24:36.375Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "e8d5c0db-0c4c-48be-94f8-34d7d63c7f0f" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.4:5700 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.409Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "10.132.0.40" "Go-http-client/1.1" "05425b30-8611-4fb8-8531-172b70493540" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:46218 10.134.0.29:443 10.132.0.40:34398 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-09T22:24:36.404Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 13 - "100.64.0.2" "python-requests/2.32.5" "6bf6f66b-717d-409d-ac41-339ed0d0b52b" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.2:54070 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-09T22:24:36.499Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 7 - "100.64.0.3" "python-requests/2.32.5" "16d444c8-d1c2-4cba-8d77-db521c997b83" "maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com" "10.132.0.40:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.29:54084 10.134.0.29:443 100.64.0.3:16988 maas.apps.380f67ec-f9a3-4cfd-999c-10fb221eceeb.prod.konfluxeaas.com opendatahub.maas-api-route.1