2026-06-02T05:59:45.367027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:45.367084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T05:59:45.367096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T05:59:45.355Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.133.0.33" "Go-http-client/1.1" "2056d7ab-6653-40c1-9667-15adc301efc5" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.132.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41596 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T05:59:45.329Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 38 - "100.64.0.4" "python-requests/2.32.5" "3f603f21-d77d-4d73-a84c-10334bf3a312" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:48484 10.132.0.41:443 100.64.0.4:12762 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T05:59:45.940Z] "GET /config.php HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.4" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "85a80f9a-c781-413d-9f4d-c5f12cde0884" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.4:60992 - - [2026-06-02T05:59:48.223Z] "GET /app/config/parameters.yml HTTP/1.1" 404 NR route_not_found - "-" 0 0 1 - "100.64.0.3" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:125.0) Gecko/20100101 Firefox/125.0" "8836a4f1-02dd-4fe0-a849-7caf9a1dd735" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.3:50874 - - [2026-06-02T05:59:50.812Z] "GET /.htpasswd HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.2" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36" "c607bff4-a822-44bd-ac20-9050bb52a4de" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.2:41678 - - [2026-06-02T05:59:52.614Z] "GET /backup.sql HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.4" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36" "3948fdda-a5f8-4e83-8eed-aa75b9917991" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.4:14284 - - [2026-06-02T05:59:53.437Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 125 - "-" "-" "-" "-" "-" - - 10.132.0.41:443 100.64.0.2:54516 - - [2026-06-02T05:59:54.940Z] "GET /dump.sql HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.3" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36" "be404c85-8dea-44bf-8eb4-78194652db88" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.3:52704 - - 2026-06-02T05:59:59.701641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.701701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.717673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.717832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.718081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.723799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.723870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T05:59:59.723886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T05:59:59.747299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.747340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.757042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.757159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.757338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.760521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T05:59:59.760601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T05:59:59.760613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T05:59:59.700Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 23 - "100.64.0.4" "python-requests/2.32.5" "e00b50b6-456f-4a4b-992a-594f7da1e787" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:48484 10.132.0.41:443 100.64.0.4:52160 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T05:59:59.746Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 14 - "100.64.0.3" "python-requests/2.32.5" "4b3172be-5b9b-4c55-92ce-4b19d4a83e51" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.3:4242 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T05:59:59.913Z] "POST /___proxy_subdomain_whm/login/?login_only=1 HTTP/1.1" 400 - - "-" 20 112 1 - "100.64.0.4" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36" "4d73ef3c-e69c-4ea7-881f-08d5b8e136e0" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.4:35448 - - [2026-06-02T06:00:04.841Z] "GET /___proxy_subdomain_whm/login/ HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.3" "Mozilla/5.0 (Macintosh; Intel Mac OS X 14_4_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15" "253f3bde-5e63-45d0-a793-f3a5f6d551aa" "34.230.134.149" "-" - - 10.132.0.41:80 100.64.0.3:15236 - - [2026-06-02T06:00:06.061Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 197 - "-" "-" "-" "-" "-" - - 10.132.0.41:443 100.64.0.2:28876 - - 2026-06-02T06:00:07.789528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.789605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.793262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.793379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.795735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.795769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.801609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.801735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.801842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.803299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.803355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:07.803367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.804857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.804909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:07.804920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.829974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:07.830025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:07.832934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:07.833057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:07.835318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.835350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.840802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.840914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.841012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.844645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.844707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:07.844720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:07.846694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:07.846760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:00:07.846777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:00:07.794Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.133.0.33" "Go-http-client/1.1" "f7020d20-f482-4c7f-a5f8-a0dd656826ca" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.132.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41596 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T06:00:07.788Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 16 - "100.64.0.4" "python-requests/2.32.5" "35e45888-9743-41f8-b66f-debb86536ded" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:31014 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:00:07.834Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.133.0.33" "Go-http-client/1.1" "aeba62a0-3032-43d4-82e3-e60fa413e589" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:39594 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T06:00:07.828Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 18 - "100.64.0.3" "python-requests/2.32.5" "4b610229-68b2-4c48-aa7b-4e5a21695cd2" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:48484 10.132.0.41:443 100.64.0.3:61492 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:00:24.379114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.379177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.395869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.396043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.398670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.398710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.407485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.407656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.409206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.409277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:24.409293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.410837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.410873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.418686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.418809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.420307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.420369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:24.420385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.421821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.421858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.430273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.430408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.431932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.431995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:24.432012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.433155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:24.433230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:24.433248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T06:00:24.397Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.33" "Go-http-client/1.1" "03a245ec-0cb0-4745-ad3b-8e67341ef4b8" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.132.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41596 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T06:00:24.409Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.133.0.33" "Go-http-client/1.1" "eded59e3-f503-4969-ac6b-28e906ef035f" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:39594 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T06:00:24.420Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.133.0.33" "Go-http-client/1.1" "e338237a-19b1-4978-8aef-0d3a55f06880" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:00:24.377Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 55 - "100.64.0.4" "python-requests/2.32.5" "9a3adf43-e5a2-4c48-be8b-329b68cc4150" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:64028 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:00:42.986026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:42.986074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:42.999843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:42.999967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.002435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.002471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.010936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.011049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.012419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.012472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:43.012484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.013687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.013757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:43.013772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.035748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:43.035784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:43.045434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:43.045566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:43.047881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.047914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.055725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.055844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.057318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.057373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:00:43.057385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:00:43.058463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:43.058516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:00:43.058527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:00:43.001Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.33" "Go-http-client/1.1" "625b64da-b145-4742-bd78-937b2876d26f" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.132.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41596 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-02T06:00:42.984Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 29 - "100.64.0.2" "python-requests/2.32.5" "3106e587-1e83-48ad-890b-fcc5258d74af" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.2:27354 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:00:43.046Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.133.0.33" "Go-http-client/1.1" "cc6b4102-8c0b-49c7-9b9f-6312cebcec02" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:39594 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-02T06:00:43.034Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 23 - "100.64.0.2" "python-requests/2.32.5" "3269366e-035b-40b1-b5c4-5abfb794710f" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:48484 10.132.0.41:443 100.64.0.2:56436 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:00:52.075973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:52.076031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:52.077539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:00:52.077605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:00:52.074Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 3 - "100.64.0.4" "python-requests/2.32.5" "94bf6d79-d739-4c8a-8859-c4fbf705a197" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.41:443 100.64.0.4:54776 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:01:08.682892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.682941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.696024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.696148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.696359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.701331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.701391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:01:08.701404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.727179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.727218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.734795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.734915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.735197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.735230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.736425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.736452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.736702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.739147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.739281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.739458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.739931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.765076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.765120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.771327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.771449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.771761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.771797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.772172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.772194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.772420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.776172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.776318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.776505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.776855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.798891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.798942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.805397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.805520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.805815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.805850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.806212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.806238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.827734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.827773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.833722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.833852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.834107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.834142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.834483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.834507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:08.855048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.855088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.857992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.858098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.860509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.860567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.866364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.866497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.866627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.868157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.868225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:01:08.868236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.869839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:08.869892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:01:08.869903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T06:01:08.681Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 19 - "100.64.0.3" "python-requests/2.32.5" "7aa1edc6-0a47-4286-a390-b4762ce0da60" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.3:26682 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:01:08.726Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 13 - "100.64.0.3" "python-requests/2.32.5" "a4f92927-46ee-4904-af8c-c4350a1e90c5" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:56240 10.132.0.41:443 100.64.0.3:11018 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T06:01:08.764Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 12 - "100.64.0.4" "python-requests/2.32.5" "0658f3b9-2399-475e-9319-cdea1630d7ab" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41906 10.132.0.41:443 100.64.0.4:3660 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T06:01:08.798Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.2" "python-requests/2.32.5" "0ee6ed2f-a83c-443f-8e5e-fe884e84773a" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:41906 10.132.0.41:443 100.64.0.2:9816 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T06:01:08.827Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "847bfbc0-f99b-48b1-a805-e916d33d51ed" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.41:443 100.64.0.2:12112 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T06:01:08.859Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "eb79d2a9-fdec-4e17-90bf-61d6ee56c85a" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:56240 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:01:08.853Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.3" "python-requests/2.32.5" "0f6dbc69-9d67-460a-b7b0-d004193f1103" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.3:11032 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:01:17.747725Z info ads ADS: new connection for node:6 2026-06-02T06:01:17.749832Z info cache read certificate from file resource=file-root:system 2026-06-02T06:01:26.639914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.639967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.654400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.654571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.654833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.658789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:26.658856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:01:26.658867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:27.071347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:27.071398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:27.072589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:27.072625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:01:27.095384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.095430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.096490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.096527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.122040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.122087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.128472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.128621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.128932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.128966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.130225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.130250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.130489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.131576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:01:27.131702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:01:27.131731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:01:26.638Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 20 - "100.64.0.4" "python-requests/2.32.5" "d82001ec-ccfc-4e35-82d7-989e541da50e" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:3908 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:01:27.070Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "604cf942-74cf-422f-a51b-93f76503e572" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.41:443 100.64.0.3:40434 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-02T06:01:27.094Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "a6941554-44c7-4472-88d3-232beeef6da1" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.41:443 100.64.0.2:17378 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-02T06:01:27.120Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 11 - "100.64.0.4" "python-requests/2.32.5" "c7e1b1ff-ef02-4752-af0c-a0dfa1f23424" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.41:443 100.64.0.4:3910 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-02T06:02:04.777098Z info ads ADS: "" 6 terminated with stream closed 2026-06-02T06:02:06.636886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.636935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.640399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.640515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.640727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.656461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.656527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:06.656538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.752366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.752415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.778879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.778927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.802191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.802239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.803803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.803837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:06.824578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.824622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.825958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:06.826001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.199403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.199451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:02:06.635Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 21 - "100.64.0.4" "python-requests/2.32.5" "385752cf-5833-4550-8ce5-7867390cae14" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.4:10750 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:06.751Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 27 - "100.64.0.2" "python-requests/2.32.5" "ccb07f00-8e8c-4864-8d93-9d96f0554fac" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.41:443 100.64.0.2:35132 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:06.800Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 3 - "100.64.0.3" "python-requests/2.32.5" "9d94043f-0dfe-4cf0-be9e-42fbd42c2790" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.41:443 100.64.0.3:30748 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:06.823Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 2 - "100.64.0.4" "python-requests/2.32.5" "c38b793f-7dcd-4eec-af6e-d3a8ca708ec0" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.41:443 100.64.0.4:10764 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:02:07.202641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.202752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.202945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.206812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.206867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:07.206879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.421365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.421417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.424230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.424359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.424584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.428138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.428198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:07.428210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.452204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.452242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.456975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.457095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.459959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.459994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.466296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.466435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.466533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.468913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.468969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:07.468980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.470472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.470521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:07.470531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.513719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.513760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.520110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.520249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.520518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.520567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.521796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.521826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.522062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.523839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.523975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.524169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.524524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.613291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.613335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.616060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.616179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.616372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.619636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.619698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:07.619710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:07.641988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.642036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.644582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.644708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.649040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:07.649102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:07.649113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T06:02:07.198Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 313 8 - "100.64.0.2" "python-requests/2.32.5" "23076929-e222-43a2-b227-cf35d14a3c29" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.2:35142 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:07.420Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.3" "python-requests/2.32.5" "d7e017f6-8161-4e2d-94b1-6d88f8fe8aca" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.3:19134 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:07.459Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.33" "Go-http-client/1.1" "97213ef8-fcf6-4a56-9774-a56992b2498e" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:02:07.451Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 19 - "100.64.0.2" "python-requests/2.32.5" "56e1955c-b396-44a4-a8ad-959988ed7048" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.2:51870 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:07.512Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 338 11 - "100.64.0.3" "python-requests/2.32.5" "9e6bf8d0-0f87-45cc-8c0b-15ae361629b3" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 100.64.0.3:30756 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-02T06:02:07.612Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.4" "python-requests/2.32.5" "c916f42c-65d1-487c-a70c-f7e47118f63e" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:10772 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:07.640Z] "DELETE /v1/api-keys/0581cc16-38cc-4847-bc16-bad81c8fc4a8 HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.4" "python-requests/2.32.5" "a6d0f958-23fb-4ebb-80af-cb56e5fd4cb1" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.4:12380 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:02:10.673401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.673451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.677321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.677399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.679232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.679288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:10.679299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.826175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.826223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.839946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.839994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:10.999888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:10.999938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.002874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.003001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.003209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.006857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.006920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.006931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.031983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.032030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.034757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.034926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.035195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.038411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.038468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.038480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.123882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.123932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.126825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.126947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.127151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.130628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.130690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.130701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.153007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.153053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.155589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.155714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.159523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.159597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.159609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.180097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.180147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.182725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.182847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.185142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.185198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.185209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T06:02:10.672Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.2" "python-requests/2.32.5" "84a0809d-6d0c-4fc5-93e6-1cdb9889b2c5" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.2:33138 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:10.824Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 15 - "100.64.0.3" "python-requests/2.32.5" "a2b0fd0d-eead-4f55-a3fd-e4328eb9f75a" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.41:443 100.64.0.3:58918 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:10.998Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 8 - "100.64.0.3" "python-requests/2.32.5" "4baaf561-6696-4ff7-aee9-1977db1c979c" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.3:19140 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.030Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 316 7 - "100.64.0.2" "python-requests/2.32.5" "5a52e2c2-c3e7-4ae1-a35f-5bfeb7d2979c" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.2:51872 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.122Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 8 - "100.64.0.4" "python-requests/2.32.5" "73e52244-42cb-4864-865f-40df327ac7ef" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:12390 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.151Z] "DELETE /v1/api-keys/8a908de9-b71f-4c88-8bed-8faa496d37ba HTTP/1.1" 200 - via_upstream - "-" 0 253 7 - "100.64.0.4" "python-requests/2.32.5" "b4873bec-2bc4-4512-949e-6e2508b1258c" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:35468 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.178Z] "DELETE /v1/api-keys/8a908de9-b71f-4c88-8bed-8faa496d37ba HTTP/1.1" 404 - via_upstream - "-" 0 29 6 - "100.64.0.3" "python-requests/2.32.5" "966d3156-17e3-4c40-90d2-12e433f19e9c" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.3:19144 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T06:02:11.276874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.276924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.279822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.279954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.280198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.283561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.283623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.283634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.304299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.304347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.307659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.307791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.310230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.310266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.315998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.316142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.316253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.317874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.317937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.317947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.319135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.319199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.319210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.400937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.400988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.404343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.404465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.404692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.408066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.408128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.408139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.430113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.430162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.434123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.434252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.436039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.436096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.436107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.456154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.456201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.459498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.459632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.462000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.462036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.468060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.468198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.468298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.469837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.469892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.469903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.471050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.471107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.471119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.554409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.554461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.557334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.557465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.557713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.561146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.561206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.561217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.582329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.582378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.585563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.585687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.587926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.587964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.594144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.594292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.594407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.596133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.596192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.596202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.597323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.597382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.597394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.616524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.616590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.619920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.620037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.622199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.622234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.628139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.628276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.628382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.629959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.630014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.630025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.631146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.631204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T06:02:11.631215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T06:02:11.724994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.725049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.727938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.728051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.728253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.731966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T06:02:11.732022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T06:02:11.732033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T06:02:11.275Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.2" "python-requests/2.32.5" "0c44cc24-cc61-431b-9f37-7f907bfd2f85" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.2:51876 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.309Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "a6d566ed-e6d2-4c97-b6af-5313535196be" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:02:11.303Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.2" "python-requests/2.32.5" "c9bf2e2a-0806-4bbb-996f-ee6bfb28cf8c" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.2:33150 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.399Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.4" "python-requests/2.32.5" "2477717c-0ca5-4fb2-9233-d6deddc9c7b6" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.4:12396 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.428Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 7 - "100.64.0.3" "python-requests/2.32.5" "62227de4-0363-4a77-ba3e-6ea7f4cd32d2" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.3:19152 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.461Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "0b82723e-83e4-47c3-ac79-3ffd422f3ba3" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:02:11.454Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.2" "python-requests/2.32.5" "350b48c6-558a-4445-8da0-efcce1cd466a" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.2:51888 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.553Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.4" "python-requests/2.32.5" "cd8e22b5-4d44-4561-bce0-17bb077cc464" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.4:12410 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.586Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.33" "Go-http-client/1.1" "60c92a14-4d70-44c5-9340-c3fe86d2794a" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:02:11.581Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.3" "python-requests/2.32.5" "cbb1e815-10b1-4376-acd5-4bd1519ad5da" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.3:19166 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.621Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.33" "Go-http-client/1.1" "efa3a8c2-3476-4576-b817-38fea58246bd" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.41:52540 10.132.0.41:443 10.133.0.33:40606 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T06:02:11.615Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.3" "python-requests/2.32.5" "952cf147-31bf-408f-b321-066d07ad6387" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:36386 10.132.0.41:443 100.64.0.3:58924 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T06:02:11.723Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 8 - "100.64.0.2" "python-requests/2.32.5" "96722203-f305-4171-b638-802e8dca2e94" "maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com" "10.133.0.33:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.41:44430 10.132.0.41:443 100.64.0.2:51892 maas.apps.416f0224-901b-429b-83b6-775fca54e03f.prod.konfluxeaas.com opendatahub.maas-api-route.1