2026-05-25T17:08:34.426315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:34.426428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:34.426618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:34.430369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:34.430430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:08:34.430441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:08:34.018Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.29" "Go-http-client/1.1" "d34356d7-9c50-4523-825e-972a92770ddb" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:52652 10.134.0.46:443 10.132.0.29:35922 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:08:34.011Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 18 - "100.64.0.2" "python-requests/2.32.5" "00991ada-6702-4340-998b-ac24dc92e508" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:46592 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:08:34.418Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 318 11 - "100.64.0.4" "python-requests/2.32.5" "d3ebf2e4-40a7-4024-8788-3f6b1e29c518" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.4:18252 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:08:42.462472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:42.462520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:42.466354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:42.466463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:42.468882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.468917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.477188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.477348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.477448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.479290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.479342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:08:42.479352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:42.480622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:42.480676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:08:42.480688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:08:42.468Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.132.0.29" "Go-http-client/1.1" "4e3311bb-8acd-4250-b009-401f52108c7c" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:52652 10.134.0.46:443 10.132.0.29:35922 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:08:42.461Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 19 - "100.64.0.3" "python-requests/2.32.5" "a97fc296-f636-497c-9e2a-b5b32bc99f41" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.3:48898 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:08:45.397250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.397295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.403332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.403451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.403638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.407382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:45.407434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:08:45.407445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:08:45.396Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 11 - "100.64.0.4" "python-requests/2.32.5" "ef942d61-bffd-439f-86a7-b5c5630302ba" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.4:45352 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:08:53.444524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:53.444569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:53.449855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:53.449963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:53.452276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.452311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.452327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.458518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.458632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.458728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.458806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.461504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.461526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.461568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:08:53.461578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.461591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:08:53.461598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:08:53.462852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:08:53.462902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:08:53.462913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:08:53.451Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.29" "Go-http-client/1.1" "4343f9a1-a767-48c5-8366-1c3694f33164" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:52652 10.134.0.46:443 10.132.0.29:35922 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:08:53.443Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 19 - "100.64.0.2" "python-requests/2.32.5" "3db56f46-d588-442a-9bbc-2dd279554e2a" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:58046 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:08:55.362Z] "GET / HTTP/1.1" 404 NR route_not_found - "-" 0 0 1 - "100.64.0.4" "Go-http-client/1.1" "1b4b0b7e-6bd5-4753-8664-5bd0a387c3fd" "54.162.231.191" "-" - - 10.134.0.46:80 100.64.0.4:25790 - - [2026-05-25T17:08:55.658Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.134.0.46:443 100.64.0.4:33238 - - 2026-05-25T17:09:02.828290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.828339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.836422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.836548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.836763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.840734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:02.840796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:09:02.840806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:09:02.827Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 13 - "100.64.0.3" "python-requests/2.32.5" "4d33f631-de6b-4b1e-ac9b-9eb571542ff0" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.3:14028 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:09:12.937Z] "GET / HTTP/1.1" 404 NR route_not_found - "-" 0 0 1 - "100.64.0.3" "Mozilla/5.0 (compatible; InternetMeasurement/1.0; +https://internet-measurement.com/)" "c07583b2-aba0-444e-b22d-a3e88ec26613" "54.162.231.191" "-" - - 10.134.0.46:80 100.64.0.3:45064 - - 2026-05-25T17:09:19.123725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:19.123783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:19.128520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:19.128645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:19.130777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:19.130840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:09:19.130856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:09:19.122Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.3" "python-requests/2.32.5" "613aa815-fa77-4869-85a6-d3e75a36f24e" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.3:60156 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:09:36.450769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:36.450818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:36.456708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:36.456833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:36.459056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:09:36.459111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:09:36.459121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:09:36.449Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.4" "python-requests/2.32.5" "0f2919f4-e9c5-40a1-9818-eec800fa2257" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:7768 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:09:53.722259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:53.722306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:53.729689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:53.729816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:53.732027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:09:53.732083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:09:53.732093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:09:53.721Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 11 - "100.64.0.2" "python-requests/2.32.5" "d495b897-cb51-4cc5-87ec-55cdf0348383" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.2:40444 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:10:11.185719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:11.185763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:11.192087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:11.192197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:11.194625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:11.194676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:11.194686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:10:11.184Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 10 - "100.64.0.2" "python-requests/2.32.5" "390b9b29-cb8f-4c61-b4f1-fb4e02a22764" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:43774 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:10:23.202498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.202543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.209580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.209706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.209901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.214928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:23.214986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:10:23.214996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:10:23.201Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 13 - "100.64.0.3" "python-requests/2.32.5" "84df6e62-05e0-4026-a2f1-22e4af86580d" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.3:38040 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:10:31.250357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:31.250403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:31.265727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:31.265839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:31.279531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.279563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.286154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.286294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.286390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.290535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.290588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:31.290599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:31.292815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:31.292870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:10:31.292886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:10:31.278Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.132.0.29" "Go-http-client/1.1" "24baca9f-75f4-4313-80fc-ebbd1f369af3" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35890 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-25T17:10:31.249Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 43 - "100.64.0.4" "python-requests/2.32.5" "66569e40-dc9d-47fe-8181-67f83f9658ee" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.4:6070 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:10:37.617Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 1 - "-" "-" "-" "-" "-" - - 10.134.0.46:443 100.64.0.3:50418 - - 2026-05-25T17:10:43.460298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.460345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.471450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.471562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.471752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.476491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.476546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:10:43.476557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:43.500197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.500258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.505882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.505984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.506146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.509918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:43.509965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:43.509975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:10:43.459Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 17 - "100.64.0.2" "python-requests/2.32.5" "a1bf1283-b797-4f96-9dda-17797c50bc26" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.2:1354 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:10:43.499Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 10 - "100.64.0.4" "python-requests/2.32.5" "97c676f7-bd64-4c9e-a487-7df70eab8a2f" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:59614 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:10:51.550328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.550376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.554520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.554632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.557313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.557344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.564110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.564243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.564338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.566535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.566589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:51.566600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.567977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.568028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:51.568039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.590861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:51.590898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:51.594378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:51.594474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:51.596645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.596676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.602939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.603046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.603132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.606938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.606986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:10:51.606997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:10:51.609036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:10:51.609086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:10:51.609097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:10:51.556Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.132.0.29" "Go-http-client/1.1" "3dfed7b4-07b6-41a3-a9a8-1ea6f1b6cbb4" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35890 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-25T17:10:51.549Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 18 - "100.64.0.4" "python-requests/2.32.5" "fe977643-5405-4cf2-b856-8d22aa6b0767" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:44870 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:10:51.595Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.132.0.29" "Go-http-client/1.1" "d84074fc-5432-4ecc-bd23-5ec27447171f" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:42424 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-25T17:10:51.589Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 19 - "100.64.0.3" "python-requests/2.32.5" "7a467059-5d8e-4c93-82c6-858c5cdd7f3b" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.3:13786 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:11:08.283923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.283974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.290380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.290493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.293125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.293160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.304582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.304696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.306802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.306856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:08.306866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.308309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.308339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.319271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.319372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.321198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.321265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:08.321276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.322547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.322579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.332648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.332748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.334605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.334649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:08.334659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.335955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:08.336011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:08.336023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:11:08.292Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 14 - "10.132.0.29" "Go-http-client/1.1" "864599b6-f598-4e37-a661-e7d9d849d372" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35890 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-25T17:11:08.307Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 13 - "10.132.0.29" "Go-http-client/1.1" "04bd6c33-4b8f-4d63-9a11-09c3f243b4b3" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:42424 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-25T17:11:08.321Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.132.0.29" "Go-http-client/1.1" "ef131123-a2f6-40d1-b1dd-b999c76da493" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:11:08.282Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 53 - "100.64.0.2" "python-requests/2.32.5" "5265b946-c941-4554-a155-c61c51a95cff" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:16782 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:11:24.871342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.871390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.877555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.877671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.880589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.880625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.891039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.891149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.893331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.893386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:24.893397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.894901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.894950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:24.894961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.916303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.916333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.921499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.921588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.923820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.923849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.932884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.932986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.934836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.934881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:24.934891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.936177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:24.936240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:24.936252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:11:24.879Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 13 - "10.132.0.29" "Go-http-client/1.1" "9a70f059-362c-466f-947b-3267dcad3b31" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35890 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-25T17:11:24.870Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 24 - "100.64.0.4" "python-requests/2.32.5" "8851e5aa-07b5-4b24-94f5-a702f5602315" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:19550 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:11:24.923Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.132.0.29" "Go-http-client/1.1" "36857ff0-de15-4819-87d1-516bcacfe32f" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:42424 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-25T17:11:24.915Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 20 - "100.64.0.2" "python-requests/2.32.5" "aeb82197-b4cb-4f23-828d-9850699211f3" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:57692 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:11:33.955407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:33.955457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:33.956776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:33.956807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:11:33.954Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.3" "python-requests/2.32.5" "e15247d0-6aeb-4c22-b11f-1cefd7911408" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.46:443 100.64.0.3:26358 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:11:50.580346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.580394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.587388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.587503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.587689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.593240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.593296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:11:50.593307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.620021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.620055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.628117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.628248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.628492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.628521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.629451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.629474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.629665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.631665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.631798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.631971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.632402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.652323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.652357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.658776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.658886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.659118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.659146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.659416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.659441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.680272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.680301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.686919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.709129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.709162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.712383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.712492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.715108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.715139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.721288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.721392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.721478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.723354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.723406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:11:50.723416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:11:50.725041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:11:50.725089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:11:50.725100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:11:50.579Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 14 - "100.64.0.2" "python-requests/2.32.5" "85e4124f-8a54-4755-a139-7f6e84c6ae90" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.2:59640 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:11:50.619Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 12 - "100.64.0.4" "python-requests/2.32.5" "e7c1ac01-6133-4092-85db-d6c216b746a5" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:42494 10.134.0.46:443 100.64.0.4:15386 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-25T17:11:50.651Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "69dcbab4-3489-4b4d-b007-3c0560245239" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:42504 10.134.0.46:443 100.64.0.3:41160 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-25T17:11:50.679Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "b06c7bee-942e-425a-a5d3-0ba15be2711c" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.46:443 100.64.0.3:16028 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-25T17:11:50.714Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.132.0.29" "Go-http-client/1.1" "229cc233-9e74-4634-8aa4-e4e31ce66042" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:57054 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:11:50.708Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.2" "python-requests/2.32.5" "5a867256-c25e-49e0-b919-dfa6d27c4027" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.2:59644 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-25T17:11:59.643022Z info ads ADS: new connection for node:6 2026-05-25T17:11:59.648469Z info cache read certificate from file resource=file-root:system 2026-05-25T17:12:06.438126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.438174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.444266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.444383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.444587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.448436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.448491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:12:06.448501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.796494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.796532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.797632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.797664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.823041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.823075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.824061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.824091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.846461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.846493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.853276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.853385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.853614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.853642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.854705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.854731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.854937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.856146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:06.856277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:12:06.856289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:12:06.436Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 11 - "100.64.0.4" "python-requests/2.32.5" "be5cbf5b-6d1d-4202-b6e5-0c961913ddf5" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:5820 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:12:06.795Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "d9260935-34bc-4a31-8f64-3311d4eabf06" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.46:443 100.64.0.4:2666 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-25T17:12:06.822Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 1 - "100.64.0.3" "python-requests/2.32.5" "263ce851-125c-428b-8560-7065ae4ed45d" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.46:443 100.64.0.3:42542 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-25T17:12:06.845Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 10 - "100.64.0.2" "python-requests/2.32.5" "8c71e081-5ffe-4eeb-8588-a0172ec3df7c" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.46:443 100.64.0.2:44094 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.e2e-external-model.0 2026-05-25T17:12:44.535105Z info ads ADS: "" 6 terminated 2026-05-25T17:12:48.682714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.682771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.690486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.690618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.690829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.704344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.704433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:12:48.704449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.741955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.741997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.747188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.747315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.749954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.749994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.756243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.756394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.756504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.758450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.758510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:12:48.758526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.760130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.760218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-25T17:12:48.760233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.810506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.810545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.816998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.817136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.817402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.817441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.818445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.818476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.818687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.820958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.821100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.821313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.821684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.855304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.855334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.861765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.861886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.862100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.862127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.862404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.862425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.862606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.864862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.864998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.865168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.865452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.888480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.888510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.895505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.895625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.895834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.895861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.896100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.896121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.896317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.898431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.898571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.898747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.898988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.927680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.927714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.934897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.935085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.937198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.937363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.937542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.937800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.965706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.965739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.972785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:48.999642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:48.999681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.005924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.006062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.006318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.006356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.006603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.006632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.037667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.037706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.044878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.071022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.071055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.077917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.078038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.078269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.078295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.078526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.078549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.103028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.103060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.109386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.109511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.109721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.109753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.109982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.110003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.143360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.143391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.150937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.151059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.151287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.151314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.151553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.151574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.181051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.181082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-25T17:12:49.187958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-25T17:12:48.681Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 320 22 - "100.64.0.2" "curl/7.76.1" "edcd814e-6f5d-468f-9522-15c68f457963" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.2:28546 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:12:48.749Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.29" "Go-http-client/1.1" "2e7ce36b-5f54-4255-bd6d-d3d7a41beae3" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 10.132.0.29:47426 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-25T17:12:48.741Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 19 - "100.64.0.4" "curl/7.76.1" "c693ca4a-a394-49f9-a835-ee41a1051779" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:60660 10.134.0.46:443 100.64.0.4:38904 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-25T17:12:48.810Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 321 11 - "100.64.0.3" "curl/7.76.1" "5b99f30d-3dbf-445e-be5d-1d0b7a847a03" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 100.64.0.3:33186 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:48.854Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 362 10 - "100.64.0.2" "curl/7.76.1" "a89b1e21-4ef0-491a-919d-a36d6740bfeb" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 100.64.0.2:23820 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:48.888Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 447 10 - "100.64.0.4" "curl/7.76.1" "ce7aa713-75ff-451d-9057-18d8344bf6ae" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 100.64.0.4:38912 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:48.927Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 427 10 - "100.64.0.3" "curl/7.76.1" "1257b9b3-783a-458d-8765-12dffdbe7877" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:52652 10.134.0.46:443 100.64.0.3:3250 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:48.965Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "02bb166a-5818-4360-b3ac-a28ad119a9ab" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:52652 10.134.0.46:443 100.64.0.4:53530 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:48.999Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "6b20c19d-8d4d-461e-98f4-bf7ec8b88069" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:35158 10.134.0.46:443 100.64.0.2:28552 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.037Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "f0b10632-8e9c-4a72-acd2-22d06d7aae67" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.46:443 100.64.0.3:3264 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.070Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "eb11eacf-6400-459b-aaff-1ec573c5aabc" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:40562 10.134.0.46:443 100.64.0.3:33190 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.102Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "9652b0bd-4297-4de9-ab59-1582db11c009" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.46:443 100.64.0.4:53532 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.142Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.2" "curl/7.76.1" "9913c005-b03f-4b39-a21f-59be586b9f30" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.46:443 100.64.0.2:23834 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.180Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "01dc6429-ccd8-4132-8c84-3a024c75dd32" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.46:40568 10.134.0.46:443 100.64.0.4:38922 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 2026-05-25T17:12:49.214817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.214848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.215669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.215696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.243761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.243792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.249084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.249169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.253491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-25T17:12:49.253545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-25T17:12:49.253556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-25T17:12:49.214Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 - - "-" 100 0 1 - "100.64.0.3" "curl/7.76.1" "0c32fa2e-9f66-4452-a202-1dfdd22889d3" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.46:443 100.64.0.3:33198 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-25T17:12:49.242Z] "DELETE /v1/api-keys/7cf8342a-bf37-45f1-bae7-ab97e08b7d40 HTTP/2" 200 - via_upstream - "-" 0 334 10 - "100.64.0.2" "curl/7.76.1" "d6b8d057-0076-40ec-9530-2fb036509d59" "maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com" "10.132.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.46:43794 10.134.0.46:443 100.64.0.2:23842 maas.apps.6d0040cf-500d-4841-be00-cc94760aa3b9.prod.konfluxeaas.com opendatahub.maas-api-route.1