2026-04-16T21:23:58.109256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.109305Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.114375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.114496Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.114650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.116677Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.116726Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:23:58.116761Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:23:58.116770Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:23:58.108Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 8 - "100.64.0.3" "python-requests/2.32.5" "75726c4a-4412-4462-8d70-4d8dd7e6254b" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:54578 10.134.0.47:443 100.64.0.3:57400 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:24:06.153841Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.153893Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.157481Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.157602Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.159397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.159431Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.159444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.165289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.165397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.165499Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.165573Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166170Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166228Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166241Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166285Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:24:06.166295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.166306Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:24:06.166311Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.167303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.167341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:06.167370Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:24:06.167380Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:24:06.158Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "c0ed2561-29c4-4c3d-a138-ad51aa2cdcad" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:48060 10.134.0.47:443 100.64.0.4:60032 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-16T21:24:06.152Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 14 - "100.64.0.2" "python-requests/2.32.5" "f4658d08-8a8f-4415-bd55-97d6157e965d" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.2:46374 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:24:15.232698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.232750Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.237965Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.238114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.238271Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.240553Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.240598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:15.240630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:24:15.240639Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:24:15.231Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 327 9 - "100.64.0.2" "python-requests/2.32.5" "52a9bd9d-45b8-4526-90cc-5a569513ba61" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:54578 10.134.0.47:443 100.64.0.2:29238 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:24:20.312Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.134.0.47:443 100.64.0.4:42352 - -
2026-04-16T21:24:31.505558Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.505610Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.510275Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.510401Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.511107Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.511158Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:24:31.511192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:24:31.511201Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:24:31.504Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 6 - "100.64.0.3" "python-requests/2.32.5" "9d1b852c-1a27-45d3-8902-545695d8ef31" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:54578 10.134.0.47:443 100.64.0.3:64280 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:24:48.598533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.598582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.604790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.604923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.605780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.605837Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:24:48.605870Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:24:48.605879Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:24:48.597Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.3" "python-requests/2.32.5" "75876cca-3bf5-442b-a568-6b5402334651" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.3:1374 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:25:05.802894Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.802946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.808835Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.808965Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.809810Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.809861Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:05.809894Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:25:05.809903Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:25:05.801Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.4" "python-requests/2.32.5" "6aa8bd54-ca3c-45eb-b907-520da7f494b5" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.4:38762 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:25:23.197312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.197364Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.203584Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.203708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.204569Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.204617Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:23.204649Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:25:23.204659Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:25:22.789Z] "GET / HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/118.0" "0f7abe73-845e-4fc3-80ef-1bfa08717764" "34.194.243.162" "-" - - 10.134.0.47:80 100.64.0.2:36424 - -
[2026-04-16T21:25:23.196Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.2" "python-requests/2.32.5" "0d954a8c-9ea9-4bc1-9029-2d7071c59780" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.2:37486 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:25:40.879402Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.879451Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.885791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.885921Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.886280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.890252Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.890308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:40.890344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:25:40.890353Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:25:40.878Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 12 - "100.64.0.4" "python-requests/2.32.5" "b25b94e9-c379-40ec-b17d-f58c410c5eea" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.4:11060 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:25:48.925205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.925254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.938530Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.938678Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.952693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.952740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.959084Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.959208Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.959332Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.960075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.960126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.960159Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:25:48.960168Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:25:48.961244Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.961296Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:25:48.961330Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:25:48.961340Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:25:48.951Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "100.64.0.3" "Go-http-client/1.1" "5a4d9070-7c61-4b85-9c14-ae19c180242d" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39286 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-16T21:25:48.924Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 342 37 - "100.64.0.2" "python-requests/2.32.5" "9250b887-a1d7-4238-a8a5-efceaadb482e" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.2:59296 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:06.758770Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.758817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.765322Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.765443Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.765595Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.767567Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.767613Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:06.767650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:06.767659Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:26:06.757Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 9 - "100.64.0.3" "python-requests/2.32.5" "9e862d78-31a8-4878-9622-a09d970859ee" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.3:42476 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:06.790626Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.790666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.796262Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.796374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.796510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.798414Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.798458Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:06.798489Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:26:06.798498Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:26:06.789Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 8 - "100.64.0.4" "python-requests/2.32.5" "43d3a6f9-5356-4c15-b08a-9d04890b7cf0" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:55194 10.134.0.47:443 100.64.0.4:26458 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:14.830034Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.830086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.834312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.834445Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.836897Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.836933Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.842739Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.842856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.842975Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.843698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.843753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.843787Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:14.843796Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.845448Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.845491Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.845523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:14.845533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.874703Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.874753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.877850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.877979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.879794Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.879829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.885269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.885377Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.885479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.887715Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.887769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.887804Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:14.887814Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.889700Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.889743Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:14.889774Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:14.889784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:26:14.836Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 7 - "100.64.0.3" "Go-http-client/1.1" "21658250-9d3d-4977-8b27-fa90e316705a" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39286 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-16T21:26:14.828Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 16 - "100.64.0.2" "python-requests/2.32.5" "4c2572bc-7b6c-44b3-95d9-492b13df2397" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.2:44988 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:26:14.879Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 8 - "100.64.0.3" "Go-http-client/1.1" "3060a6d4-b689-4a9a-bcb6-b24d011f8988" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53402 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-16T21:26:14.873Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 16 - "100.64.0.4" "python-requests/2.32.5" "593fa65a-769a-427f-8143-d4bcedd0003a" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.4:22444 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:31.449848Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.449900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.456018Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.456159Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.458392Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.458426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.467697Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.467824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.468466Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.468515Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.468588Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:31.468598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.470653Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.470687Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.479559Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.479673Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.480384Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.480432Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.480464Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:31.480473Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.482422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.482453Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.490940Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.491069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.491648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.491689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.491719Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:31.491728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.492806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.492848Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:31.492885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:31.492895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:26:31.457Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "100.64.0.3" "Go-http-client/1.1" "e1d27d3e-2e75-4310-b9c5-7b4bc8ea9f28" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39286 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-16T21:26:31.469Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "100.64.0.3" "Go-http-client/1.1" "7d6f73ea-f8b5-48d8-a131-9c1fe934c705" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53402 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-16T21:26:31.481Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "100.64.0.3" "Go-http-client/1.1" "6652cf9b-c238-44a3-8df7-0e35776c42da" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53642 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-16T21:26:31.448Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 44 - "100.64.0.3" "python-requests/2.32.5" "944e5951-df88-4f3f-9f8b-a935009e768d" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.3:24416 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:45.909909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.909962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.916633Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.916773Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.919544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.919580Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.930736Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.930874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.938112Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.938167Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.938202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:45.938211Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.939973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.940035Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.940066Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:45.940075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.961750Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.961791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.967150Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.967271Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.969097Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.969130Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.977061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.977185Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.977769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.977817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.977849Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:45.977858Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.978878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.978915Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:26:45.978945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:26:45.978954Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:26:45.918Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 19 - "100.64.0.3" "Go-http-client/1.1" "83ad7ec5-f99f-4d92-b1c2-e7eb72cf9159" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39286 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-16T21:26:45.908Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 31 - "100.64.0.2" "python-requests/2.32.5" "b4a8fc5a-59c9-4352-9625-b7330732c246" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.2:64996 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:26:45.968Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.3" "Go-http-client/1.1" "85a50ebd-1c65-481b-b688-cec82bfad0f1" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53402 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-16T21:26:45.960Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 18 - "100.64.0.2" "python-requests/2.32.5" "8073378f-c0fc-477a-be1e-c85cbc8c1601" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.2:34362 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:26:54.989144Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:54.989200Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:54.990501Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:26:54.990544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:26:54.988Z] "GET /maas-api/v1/models HTTP/1.1" 401 -  - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "75a4483b-ab33-4dfa-a5da-337faef5a965" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.47:443 100.64.0.4:7182 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:27:11.624239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.624288Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.629850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.629969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.630151Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.633294Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.633342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.633375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:27:11.633385Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.661912Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.661949Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.668519Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.668627Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.668894Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.668924Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.671027Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.671069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.671509Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.674064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.674199Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.674312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.674522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.675100Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.694416Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.694453Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.700868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.700973Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.701247Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.701278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.701729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.701752Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.723188Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.723225Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.729157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.729267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.729520Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.729549Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.730078Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.730102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:11.756972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.757024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.759631Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.759730Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.761712Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.761745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.767434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.767539Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.767631Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.769354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.769401Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.769434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:27:11.769443Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.771148Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.771189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:11.771219Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:27:11.771228Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:27:11.623Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 10 - "100.64.0.3" "python-requests/2.32.5" "28f29357-e88f-4ecd-9d7a-9d1e2bb9324a" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.3:43964 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:27:11.661Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 13 - "100.64.0.4" "python-requests/2.32.5" "9563701f-31b2-450d-bac6-4d7e1c53e1cc" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39784 10.134.0.47:443 100.64.0.4:26840 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-16T21:27:11.693Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "43df7ff4-53f8-4420-a551-b6270500aa59" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39784 10.134.0.47:443 100.64.0.3:41432 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-16T21:27:11.722Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "8ba42622-fb5f-487c-b28b-599aa4d54c68" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:38760 10.134.0.47:443 100.64.0.2:59702 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-16T21:27:11.761Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.3" "Go-http-client/1.1" "66a7ef42-e19e-45b8-b3d9-7a38b6c07e64" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:39800 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2
[2026-04-16T21:27:11.756Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 15 - "100.64.0.3" "python-requests/2.32.5" "84d0543b-72f7-4f01-a778-118709da13e8" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.3:43978 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-16T21:27:20.647426Z	info	ads	ADS: new connection for node:6
2026-04-16T21:27:20.649727Z	info	cache	read certificate from file	resource=file-root:system
2026-04-16T21:27:25.316590Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.316639Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.325564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.325708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.326059Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.330807Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.330859Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.330898Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:27:25.330907Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.688031Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.688085Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.689185Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.689240Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.718011Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.718048Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.718895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.718925Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:27:25.740725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.740760Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.747393Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.747502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.747751Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.747781Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.749727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.749757Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.750205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.758788Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.758949Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:27:25.759077Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:27:25.759088Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:27:25.315Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 15 - "100.64.0.4" "python-requests/2.32.5" "fb55a4f7-dbd9-45b4-b8c8-8de6ecdf05b6" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:42860 10.134.0.47:443 100.64.0.4:61694 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:27:25.686Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "c6040f73-1369-4a45-92ab-ac1a375a7c35" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.47:443 100.64.0.2:13610 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-16T21:27:25.717Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 1 - "100.64.0.4" "python-requests/2.32.5" "846e4295-ffc5-46f0-a6f9-f320d14003db" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.47:443 100.64.0.4:17158 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-16T21:27:25.739Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 19 - "100.64.0.2" "python-requests/2.32.5" "8e3b330d-3ce2-40df-8c2b-958d43153845" "httpbin.org" "52.6.193.180:443" outbound|443||httpbin.org 10.134.0.47:51000 10.134.0.47:443 100.64.0.2:5172 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.e2e-external-model.0
2026-04-16T21:28:03.436740Z	info	ads	ADS: "" 6 terminated with stream closed
2026-04-16T21:28:05.681764Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.681823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.687715Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.687852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.688048Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.698745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.698823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.698871Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-16T21:28:05.698885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.744419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.744457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.748286Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.748394Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.750148Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.750178Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.755727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.755853Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.755946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.756531Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.756574Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.756605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:28:05.756614Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.757638Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.757691Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.757725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:28:05.757735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:05.808557Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.808605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.814788Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.814924Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.815236Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.815287Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.817436Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.817468Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.817655Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.818425Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.818576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.818695Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.818885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.819299Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.858585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.858625Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.864832Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.864962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.865227Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.865266Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.865728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.865765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.865939Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.866645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.866792Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.866910Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.867126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.867526Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.895263Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.895309Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.904878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.905082Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.905439Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.905522Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.906085Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.906114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.933946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.933982Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.940846Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.940963Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.941226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.941256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.941801Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.941824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-16T21:28:05.680Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 320 18 - "100.64.0.3" "curl/7.76.1" "afda00f0-3752-431b-a070-323641f63a17" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:42860 10.134.0.47:443 100.64.0.3:53476 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:28:05.749Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.3" "Go-http-client/1.1" "7f73255f-d96c-468a-99d3-b635a172aa70" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53642 10.134.0.47:443 100.64.0.3:24832 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-16T21:28:05.743Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 14 - "100.64.0.2" "curl/7.76.1" "a25431af-9b5e-4605-aaf8-2e87b223fe06" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.2:53888 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-16T21:28:05.807Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 532 11 - "100.64.0.4" "curl/7.76.1" "446327cd-c39f-43f0-aa6d-49a8173e7793" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:48060 10.134.0.47:443 100.64.0.4:49454 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:05.858Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 453 9 - "100.64.0.3" "curl/7.76.1" "d2f7707a-daaf-4d4b-9a5f-d0eba2792120" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:48060 10.134.0.47:443 100.64.0.3:53478 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:05.894Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 11 - "100.64.0.2" "curl/7.76.1" "edf2aac9-6be1-4a35-b6a6-67a4de02ff2b" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:48060 10.134.0.47:443 100.64.0.2:53892 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:05.933Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "c53723a5-c2d4-4eda-a761-10e4abc34b32" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 100.64.0.4:49464 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
2026-04-16T21:28:05.967267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.967301Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.973677Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.973795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.974063Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.974093Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.974541Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:05.974564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-16T21:28:06.002447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.002497Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.008253Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.008376Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.008615Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.008646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.009174Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.009198Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.036668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.036701Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.042427Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.042548Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.042778Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.042808Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.043251Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.043276Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.072905Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.072938Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.078868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.078984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.079266Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.079295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.079745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.079765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.105502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.105535Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.111157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.111272Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.111501Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.111529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.112005Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.112026Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.138130Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.138162Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.143975Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.144116Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.144349Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.144378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.144862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.144884Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.174311Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.174348Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.181587Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.181711Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.181976Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.182024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.182491Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.182516Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.210719Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.210758Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.211637Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.211669Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.240326Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.240364Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.245974Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.246103Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.248812Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.248875Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-16T21:28:06.248910Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-16T21:28:06.248920Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-16T21:28:05.966Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "1c8f7786-705e-4cfc-bbca-8bfe7851791d" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:37220 10.134.0.47:443 100.64.0.3:53490 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.001Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "e716870c-1bca-44fd-93eb-6c3b5dcd8de8" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:53642 10.134.0.47:443 100.64.0.3:29040 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.036Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "e3d63eeb-3768-437a-8822-1a694cb41845" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 100.64.0.2:53908 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.072Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "fe1e4f46-8b58-461b-8614-f9f9a8f3a5fd" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:37230 10.134.0.47:443 100.64.0.4:9900 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.105Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "f608cbcd-dd28-428b-a3e7-d77ae32ef985" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 100.64.0.2:40070 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.137Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "f3ba5842-e775-4e5b-a99c-8ccede87d414" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:37244 10.134.0.47:443 100.64.0.4:49466 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.173Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 9 - "100.64.0.3" "curl/7.76.1" "6f1dd9fe-070a-49ed-a885-3e04b9a2a839" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 100.64.0.3:53500 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.210Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 -  - "-" 100 0 1 - "100.64.0.3" "curl/7.76.1" "bbf2cf75-88c0-4bc6-9d41-b05536ff1c48" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 100.64.0.3:29050 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-16T21:28:06.239Z] "DELETE /v1/api-keys/ed9ed6a4-9915-426e-9350-c64a21edb0f3 HTTP/2" 200 - via_upstream - "-" 0 334 9 - "100.64.0.4" "curl/7.76.1" "7051162d-cd29-40df-9088-34ad5cb93b96" "maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com" "10.132.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.47:49536 10.134.0.47:443 100.64.0.4:9912 maas.apps.6373ddbc-e51c-4b2e-8964-6e21d83b4b1e.prod.konfluxeaas.com opendatahub.maas-api-route.1