2026-06-05T18:25:25.195911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:25:25.177Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 18 - "100.64.0.4" "python-requests/2.32.5" "1fb7de90-ad4d-4397-aa32-df52903fb78f" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.4:27574 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:25:37.135812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.135857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.149675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.149791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.149987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.154344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:37.154404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:25:37.154414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:25:37.134Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 20 - "100.64.0.2" "python-requests/2.32.5" "4e1795bc-2138-4301-87ef-b124ceaa6fb5" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.2:40696 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:25:45.184372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:45.184422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:45.197786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:45.197919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:45.209775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.209812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.215592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.215725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.215826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.217520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.217577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:25:45.217587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:45.218849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:45.218904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:25:45.218924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T18:25:45.208Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.134.0.28" "Go-http-client/1.1" "ae9d12c9-ab1e-4599-9f1f-0f5db767aaed" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:44474 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T18:25:45.182Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 36 - "100.64.0.3" "python-requests/2.32.5" "3d8623ed-d4f0-4294-b512-ae166465a80d" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.3:15058 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:25:57.250143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.250193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.266120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.266331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.266731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.271563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.271658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:25:57.271672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:25:57.295419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.295462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.305698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.305812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.305995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.309296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:25:57.309358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:25:57.309369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:25:57.247Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 23 - "100.64.0.4" "python-requests/2.32.5" "8d90e3e8-31bd-4b09-a14a-bbeb55d4b928" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.4:32666 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:25:57.293Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 15 - "100.64.0.2" "python-requests/2.32.5" "b0c05d40-ccc4-4df5-9a95-ea2a12885890" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.2:25520 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:26:05.341353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.341407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.345056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.345184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.348047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.348085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.354124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.354239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.354356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.356073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.356136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:05.356146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.357429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.357492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:26:05.357502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:05.378748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.378791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.381648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.381765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.384066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.384100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.389559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.389695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.389808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.392516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.392581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:05.392591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.393732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:05.393782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:05.393792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:26:05.346Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.134.0.28" "Go-http-client/1.1" "cf68d59b-dbcb-41be-8b54-a0e26f2390b7" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:44474 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T18:26:05.339Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 18 - "100.64.0.4" "python-requests/2.32.5" "b4b6bab7-2c38-4196-9035-70f58bd38192" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.4:47160 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:26:05.382Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "10.134.0.28" "Go-http-client/1.1" "693d22d5-2e71-4ef9-9ef5-606ea710c0b3" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:47380 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T18:26:05.377Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 16 - "100.64.0.3" "python-requests/2.32.5" "6601bc26-632d-49e8-9166-c32d8deebf8e" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.3:5384 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:26:21.840097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:21.840148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:21.855113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:21.855259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:21.858334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.858376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.868252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.868424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.870132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.870196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:21.870206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.871973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.872013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.879999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.880137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.881720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.881782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:21.881793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.883478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.883512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.892009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.892150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.893648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.893716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:21.893727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:21.895037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:21.895109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:26:21.895121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T18:26:21.856Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 13 - "10.134.0.28" "Go-http-client/1.1" "461a6489-5084-4efd-be7d-38c3fb1c5a00" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:44474 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T18:26:21.870Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.134.0.28" "Go-http-client/1.1" "bd6aee69-3b51-425f-8652-4b703bf55558" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:47380 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T18:26:21.882Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.134.0.28" "Go-http-client/1.1" "823ba439-38ec-4e0f-9d4a-b3c85e291a1d" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:26:21.837Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 57 - "100.64.0.2" "python-requests/2.32.5" "6ca74ca1-f557-4d8b-9cc2-e83ebb9721de" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.2:6186 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:26:36.225558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.225604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.239843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.239983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.243785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.243825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.253186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.253327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.255822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.255884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:36.255894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.257431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.257491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:26:36.257501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:36.276600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.276678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.286045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.286165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.288463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.288503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.297380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.297504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.299851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.299910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:36.299921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.301065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:26:36.301118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:26:36.301130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:26:36.242Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 13 - "10.134.0.28" "Go-http-client/1.1" "b9658f05-0773-4753-a1b7-cbade9ef7774" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.52:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:44474 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T18:26:36.222Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 34 - "100.64.0.3" "python-requests/2.32.5" "5f0e4f42-08b8-402a-909e-f89c30f24899" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.3:19550 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:26:36.287Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.134.0.28" "Go-http-client/1.1" "bc36c42d-691e-43f1-894f-f02af08d6760" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.51:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:47380 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T18:26:36.275Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 25 - "100.64.0.4" "python-requests/2.32.5" "1d3fcc0c-73d4-4e5d-a4dc-6519bd9d2b07" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.4:10050 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:26:45.339078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:45.339127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:45.340799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:26:45.340835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T18:26:45.337Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 3 - "100.64.0.2" "python-requests/2.32.5" "5f987fc2-e227-4726-9cb8-a14f6d1a110a" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.32:443 100.64.0.2:16386 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:27:01.958326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.958372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.974305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.974440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.974672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.978755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:01.978819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:27:01.978829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.021109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.021156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.028380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.028500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.028782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.028814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.030011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.030034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.030244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.032021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.032142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.032301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.032845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:27:01.956Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 22 - "100.64.0.3" "python-requests/2.32.5" "9a02d581-853c-4d36-9a20-19b2596029d3" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.3:21446 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:27:02.019Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 13 - "100.64.0.4" "python-requests/2.32.5" "202551b4-f173-4b33-90cf-35167777ed4a" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:55622 10.133.0.32:443 100.64.0.4:62234 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-06-05T18:27:02.060954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.060993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.066871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.066996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.067255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.067287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.067805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.067830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.087232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.087269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.093970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.122531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.122569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.125749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.125849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.128851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.128884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.134337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.134448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.134544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.136122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.136179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:27:02.136189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:02.137866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:02.137919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:27:02.137929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T18:27:02.059Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.2" "python-requests/2.32.5" "c6ad61cc-cf24-4421-9a26-4f1ce7923542" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:36052 10.133.0.32:443 100.64.0.2:58912 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-05T18:27:02.085Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.3" "python-requests/2.32.5" "525a4de5-ac30-47b7-90c6-1aa9fb707335" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.32:443 100.64.0.3:21458 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-05T18:27:02.127Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "05d948a9-76cc-451b-8401-94fa28064661" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:55622 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:27:02.121Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.2" "python-requests/2.32.5" "85d1f702-1bd1-4030-9a1a-c77a12d83059" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:46128 10.133.0.32:443 100.64.0.2:63576 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:27:10.980525Z info ads ADS: new connection for node:6 2026-06-05T18:27:10.982821Z info cache read certificate from file resource=file-root:system 2026-06-05T18:27:15.621943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.621989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.636711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.636852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.637081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.642524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.642591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:27:15.642602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.995453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.995497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.996665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:15.996698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.020822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:16.020881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:16.022024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:16.022068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:27:16.042578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.042636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:27:15.619Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 320 22 - "100.64.0.4" "python-requests/2.32.5" "404e23ec-9483-4f7a-94fc-58c65bae780e" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:48538 10.133.0.32:443 100.64.0.4:40754 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:27:15.993Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 3 - "100.64.0.2" "python-requests/2.32.5" "b59f2a9b-44c8-4c8d-8ffe-d63e1cd35dec" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.32:443 100.64.0.2:48612 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-05T18:27:16.018Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 3 - "100.64.0.3" "python-requests/2.32.5" "670902fb-c9ea-41f8-b5d7-492e6fc0f031" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.32:443 100.64.0.3:61114 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-05T18:27:16.049841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.049985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.050287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.050320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.051561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.051588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.051863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.052773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:27:16.052883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:27:16.052893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:27:16.041Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 11 - "100.64.0.4" "python-requests/2.32.5" "d0f53c2f-9fb2-490f-926d-c9bb421a2862" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.32:443 100.64.0.4:40762 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-05T18:27:53.678407Z info ads ADS: "" 6 terminated with stream closed 2026-06-05T18:28:21.912963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.913018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.915847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.915974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.916173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.930581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:21.930693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:21.930710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:28:21.910Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 19 - "100.64.0.4" "python-requests/2.32.5" "d13bd89c-d03e-467b-8518-a2f870bbcf1f" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.4:50712 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:28:22.092116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.092170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.163804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.163858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.186225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:22.186269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:22.187657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:22.187689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:22.207529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.207572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.208937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.208976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.880572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.880644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.883915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.884047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.884252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.887920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:22.887992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:22.888006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:28:22.090Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 73 - "100.64.0.3" "python-requests/2.32.5" "cceb9dbb-daa8-4e16-a3f6-eb944e5b21b9" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.32:443 100.64.0.3:27386 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:22.184Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 3 - "100.64.0.2" "python-requests/2.32.5" "43a1d1c0-4a44-4560-8019-481746b2015f" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.32:443 100.64.0.2:41280 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:22.206Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.4" "python-requests/2.32.5" "3060a600-d636-457b-a25d-3ef41fd80773" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.32:443 100.64.0.4:44924 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:22.878Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 311 9 - "100.64.0.2" "python-requests/2.32.5" "95a4d513-b1f0-46eb-88d7-bf6e3929cc91" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.2:40720 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:28:23.262921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.262977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.265856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.265990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.266191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.269712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.269780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:23.269795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.287874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.287909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.299447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.299568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.303279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.303314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.309163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.309289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.309394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.310723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.310783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:23.310793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.311944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.311999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:23.312010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.328142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.328174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.334194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.334323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.334551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.334581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.335994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.336016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.336201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.337907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.338023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.338178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.338642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:23.478465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.478512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.481252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.481355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.481525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.484736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.484793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:23.484803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.505895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.505933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.508265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.508359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.512469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:23.512525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:23.512535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:28:23.261Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.3" "python-requests/2.32.5" "73d47009-2bf8-4b04-be8e-d613c152ff53" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.3:15154 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:23.302Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "ad4f9ed9-1b18-4912-b0d5-50ef59aed12e" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:28:23.286Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 25 - "100.64.0.3" "python-requests/2.32.5" "d8c56195-563d-4b50-87cf-9bc542a21966" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.3:27398 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:23.327Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 323 11 - "100.64.0.2" "python-requests/2.32.5" "e2dec21a-7eb9-4dcf-b531-e048a51f1e58" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:54518 10.133.0.32:443 100.64.0.2:41292 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-05T18:28:23.476Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.4" "python-requests/2.32.5" "1d7ead3c-be24-48b0-ab4f-b0e9119973a9" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.4:34664 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:23.504Z] "DELETE /v1/api-keys/ab00ab64-5b90-4fd3-a6b2-9952407840fe HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.4" "python-requests/2.32.5" "9faf42eb-69f0-4bbd-8b01-c69680a5c2e6" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.4:44940 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:28:26.535683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.535727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.539492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.539565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.541319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.541386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:26.541401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:26.725768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:26.725814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:26.740607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:26.740662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.005281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.005328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.007996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.008099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.008273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.011774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.011828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.011838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.031434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.031470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.034063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.034160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.034319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.037306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.037361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.037371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T18:28:26.533Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.3" "python-requests/2.32.5" "dacf27ae-a888-40a3-ac07-0e194f4ffdbf" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.3:27414 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:26.724Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 16 - "100.64.0.2" "python-requests/2.32.5" "f0986255-6f42-4409-82d9-e0a737c0aefe" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.32:443 100.64.0.2:40730 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.003Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 8 - "100.64.0.2" "python-requests/2.32.5" "bf738b22-075a-4786-8a22-6bdb51d09331" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.2:41298 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.029Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 317 7 - "100.64.0.4" "python-requests/2.32.5" "2d4e5624-49cc-4b29-aa6d-0e069282ac0a" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.4:44952 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T18:28:27.179668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.179708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.182345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.182450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.182641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.186194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.186251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.186261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.203320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.203361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.206139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.206235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.210291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.210347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.210357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.229378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.229415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.231922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.232015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.234532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.234581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.234591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.371698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.371739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.374466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.374582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.374777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.378175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.378233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.378243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.395538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.395582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.398784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.398889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.401116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.401150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.406995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.407145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.407260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.408665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.408736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.408751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.409936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.409999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.410013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.548744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.548787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.551717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.551822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.551992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.555718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.555780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.555791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.573431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.573473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.576491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.576604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.578163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.578224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.578239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.595310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.595344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.598193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.598280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.600439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.600475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.606075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.606208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.606304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.607569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.607659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.607673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.608816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.608865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.608876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.754050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.754103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.756896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.757022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.757229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.760666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.760736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.760750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.778606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.778677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.781721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.781835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.784072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.784108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.789860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.789998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.790099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.791535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.791596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.791607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.792869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.792920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.792931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.808390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.808425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.811286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.811385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.813509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.813540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.819100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.819225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.819315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.820550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.820609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.820619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.821696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.821745Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T18:28:27.821755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T18:28:27.960241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.960283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.962999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.963108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.963285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.966706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T18:28:27.966765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T18:28:27.966775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T18:28:27.178Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 8 - "100.64.0.3" "python-requests/2.32.5" "89876c71-f26e-4597-a371-6d5fe050ee17" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.3:27422 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.201Z] "DELETE /v1/api-keys/413e7189-ffee-4676-acf4-1392b3f96da1 HTTP/1.1" 200 - via_upstream - "-" 0 253 8 - "100.64.0.2" "python-requests/2.32.5" "e18a4ce1-5e3e-47fe-9b4e-6a88df23de58" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.2:41310 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.228Z] "DELETE /v1/api-keys/413e7189-ffee-4676-acf4-1392b3f96da1 HTTP/1.1" 404 - via_upstream - "-" 0 29 6 - "100.64.0.3" "python-requests/2.32.5" "b80230af-6f28-42cd-abb2-029a3e064840" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.3:15168 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.369Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.4" "python-requests/2.32.5" "1aff8a64-3ca2-403f-b153-fba77bf6b91e" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.4:44962 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.400Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "1eefbf07-69b0-44fa-a3df-46cd200544f2" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:28:27.394Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "662e464b-356c-47ba-b0e7-70307442fd36" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.3:27426 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.547Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.2" "python-requests/2.32.5" "aa330ccc-7fce-499e-98a5-c4865acc7bd9" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.2:41312 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.572Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.4" "python-requests/2.32.5" "02d70373-de5f-451a-8338-17695b2533e2" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.4:34680 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.599Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "9bf8c37c-6e0d-4fca-90de-e02577269097" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:28:27.594Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "bc6e8e19-a494-491b-b7fa-63c9597c3548" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.4:44978 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.752Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 312 8 - "100.64.0.2" "python-requests/2.32.5" "b1c02f9d-539b-41d4-bc12-5d8f64514084" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.2:40746 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.782Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "3edb476a-e6b6-4d3c-963d-b1d3df817aa6" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:28:27.777Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "ef9c6121-3ae6-4c15-bfd5-40fb045a721b" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.3:27436 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.812Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.28" "Go-http-client/1.1" "5e9ad65f-fc04-4231-8de8-a9af0d1bb1ab" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.32:37692 10.133.0.32:443 10.134.0.28:41650 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T18:28:27.807Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.2" "python-requests/2.32.5" "c4cd4635-87d5-4dbe-a749-b407105416be" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:57332 10.133.0.32:443 100.64.0.2:41326 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T18:28:27.958Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 8 - "100.64.0.4" "python-requests/2.32.5" "add8243a-2dd6-4410-9b08-d0480f7a9974" "maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com" "10.134.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.32:41554 10.133.0.32:443 100.64.0.4:44980 maas.apps.95a63d51-1879-4355-b838-0496146ec5c6.prod.konfluxeaas.com opendatahub.maas-api-route.1