2026-05-11T21:19:31.265769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:31.267190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:31.267245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:31.267255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:31.268283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:31.268336Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:31.268347Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:19:31.258Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.37" "Go-http-client/1.1" "d8d0a792-30d1-4352-82db-a31c368ceb09" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 10.134.0.37:54484 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-11T21:19:31.251Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.3" "python-requests/2.32.5" "77145416-e680-428f-ac93-566867a1ddd5" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.3:12684 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:19:34.033616Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.033663Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.038707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.038828Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.039061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.042600Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:34.042655Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:34.042666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:19:34.032Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 10 - "100.64.0.4" "python-requests/2.32.5" "85ccf929-755c-40ea-8575-55822b2c9e2d" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.4:48338 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:19:42.072518Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.072569Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.077299Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.077419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.079570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.079604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.079617Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.085924Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.086085Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.086183Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.086263Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.088272Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.088294Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.088342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:42.088352Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.088365Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:42.088371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.089397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:42.089444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:42.089455Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:19:42.078Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.134.0.37" "Go-http-client/1.1" "1ae4b725-cca5-4c76-9d65-726f2599a0a9" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 10.134.0.37:54484 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-11T21:19:42.071Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 18 - "100.64.0.4" "python-requests/2.32.5" "9ecea0f3-fa1e-4791-b865-4621ef723eb1" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.4:20394 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:19:51.239213Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.239263Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.244392Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.244514Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.244718Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.248110Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:19:51.248166Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:19:51.248177Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:19:51.238Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 10 - "100.64.0.2" "python-requests/2.32.5" "f638ea79-dc71-49a4-9c4c-7f095db68382" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.2:54860 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:20:07.496369Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:07.496424Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:07.500609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:07.500744Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:07.502533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:07.502602Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:20:07.502618Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:20:07.495Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 7 - "100.64.0.3" "python-requests/2.32.5" "6201164d-bee3-417a-832c-ec332c2f64f3" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.3:3214 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:20:24.525788Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:20:24.525838Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:20:24.531639Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:20:24.531760Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:20:24.533721Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:20:24.533775Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:20:24.533785Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:20:24.524Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.4" "python-requests/2.32.5" "a73d6a3d-a2da-45e6-ab3d-f2d06b206239" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.4:49802 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:20:41.687613Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:41.687669Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:41.692493Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:41.692633Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:41.694563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:41.694630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:20:41.694647Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:20:41.686Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.2" "python-requests/2.32.5" "f86368f9-d337-4e2e-8fb9-d2930fd5be9f" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.2:4158 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:20:59.033745Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:59.033797Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:59.039140Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:59.039268Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:59.041287Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:20:59.041342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:20:59.041353Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:20:59.032Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.3" "python-requests/2.32.5" "ae707fe5-de31-4d2a-a8ba-a6faa3f133e0" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.3:49368 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:21:02.744Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.132.0.29:443 100.64.0.4:35972 - -
2026-05-11T21:21:13.017503Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.017554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.022737Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.022856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.023074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.026733Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:13.026786Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:13.026797Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:21:13.016Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 10 - "100.64.0.2" "python-requests/2.32.5" "942a468b-8d49-454c-baa2-408f291f3ac0" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.2:50488 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:21:21.061371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.061418Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.074598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.074727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.086115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.086147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.092068Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.092192Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.092291Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.093858Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.093912Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:21.093923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.094996Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:21.095063Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:21.095074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:21:21.085Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.134.0.37" "Go-http-client/1.1" "127c5c11-215e-4674-b874-681d54621262" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:38168 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-11T21:21:21.060Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 342 34 - "100.64.0.3" "python-requests/2.32.5" "a3333000-cef1-4732-a9f4-5536d376da93" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.3:57332 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:21:35.203624Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.203674Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.209037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.209171Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.209378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.212921Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.212979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:35.212991Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:35.231790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.231829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.236132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.236242Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.236411Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.239773Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:21:35.239824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:21:35.239834Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:21:35.202Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 10 - "100.64.0.2" "python-requests/2.32.5" "00243e58-e223-43fc-b626-b5f850f33ae6" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.2:49970 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:21:35.230Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 9 - "100.64.0.4" "python-requests/2.32.5" "bac4d671-0f41-4801-89e2-b2cb31894af0" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.4:59218 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:21:43.264390Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.264439Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.268720Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.268847Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.271126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.271157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.276903Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.277040Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.277136Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.278939Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.278997Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:43.279026Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.280123Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.280173Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:43.280184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.300256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.300289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.303125Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.303230Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.305122Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.305152Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.310610Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.310726Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.310817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.312432Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.312486Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:43.312497Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.313547Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:43.313616Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:43.313630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:21:43.270Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.134.0.37" "Go-http-client/1.1" "f6aba673-6a6c-4a60-b0b0-619a42cea5b9" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:38168 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-11T21:21:43.263Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 16 - "100.64.0.2" "python-requests/2.32.5" "73384822-1f87-4ff3-ba19-d4ca8db7e567" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.2:44658 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:21:43.304Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 8 - "10.134.0.37" "Go-http-client/1.1" "29c6dbfb-e668-4a73-a82c-044178cfd3c2" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49066 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-11T21:21:43.299Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 14 - "100.64.0.3" "python-requests/2.32.5" "af984b4c-2d74-4d3f-aac1-9357da1b5f4c" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.3:57780 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:21:59.771839Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.771891Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.777202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.777324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.779687Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.779725Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.787892Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.788036Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.789583Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.789649Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:59.789661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.790934Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.790968Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.799098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.799207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.800630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.800675Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:59.800686Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.801951Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.801982Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.809395Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.809503Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.811555Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.811603Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:59.811614Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.812693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:21:59.812746Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:21:59.812758Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:21:59.778Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.134.0.37" "Go-http-client/1.1" "fcb848d1-57d8-48c4-bf3c-8e7959257fe3" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:38168 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-11T21:21:59.790Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.134.0.37" "Go-http-client/1.1" "6737f622-fa05-418a-bc54-f17bfe854d27" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49066 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-11T21:21:59.801Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.134.0.37" "Go-http-client/1.1" "aee63732-564d-46c1-bca1-f24f0f11503f" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-11T21:21:59.770Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 42 - "100.64.0.3" "python-requests/2.32.5" "cf297f8f-d1a0-497a-ba1f-8917f566e68f" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.3:11922 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:22:16.230512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.230560Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.235781Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.235902Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.238273Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.238305Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.247362Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.247474Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.249036Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.249091Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:22:16.249102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.250206Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.250258Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:22:16.250268Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.268571Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:16.268608Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:16.272817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:16.272923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:16.275185Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.275217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.283160Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.283275Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.284784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.284835Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:22:16.284846Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:16.286302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:16.286354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:22:16.286365Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:22:16.237Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.134.0.37" "Go-http-client/1.1" "ea8cbf54-2e6a-4f82-970e-cb58bc2018d0" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:38168 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-11T21:22:16.229Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 20 - "100.64.0.4" "python-requests/2.32.5" "ba1aff1c-9ef3-4faf-9ac8-49e16f96a274" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:58976 10.132.0.29:443 100.64.0.4:48438 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:22:16.274Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.134.0.37" "Go-http-client/1.1" "404073ba-41f1-47c1-90d0-21ea0cdd4ffa" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.36:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:49066 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-11T21:22:16.267Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 18 - "100.64.0.4" "python-requests/2.32.5" "7fa11e0f-14b1-45fc-845a-e511c044094c" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.4:52994 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:22:25.324586Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:25.324634Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:25.325795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:25.325828Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:22:25.323Z] "GET /maas-api/v1/models HTTP/1.1" 401 -  - "-" 0 0 2 - "100.64.0.2" "python-requests/2.32.5" "c7353821-e1bf-4e11-a063-d0cbb6503f36" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.29:443 100.64.0.2:34040 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:22:41.914454Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.914500Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.920198Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.920324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.920521Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.927493Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.927553Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:22:41.927564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.946051Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.946081Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.953224Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.953340Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.953591Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.953628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.955077Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.955100Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.955308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.958682Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.958823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.959033Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.959618Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:41.979143Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.979178Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.985240Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.985357Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.985619Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.985648Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.986157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.986181Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.986389Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.988160Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.988291Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.988466Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:41.988884Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.003977Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.004037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.009795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.009909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.010165Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.010196Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.010605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.010630Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.026351Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.026385Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.032464Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.032575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.032808Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.032838Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.033280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.033308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.049551Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.049585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.052479Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.052578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.055112Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.055143Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.061250Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.061371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.061466Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.064357Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.064408Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:22:42.064419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:42.066020Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:42.066071Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:22:42.066082Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:22:41.913Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 14 - "100.64.0.2" "python-requests/2.32.5" "f1f54125-ea01-4e5f-8213-778fa6525556" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.2:59184 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:22:41.945Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 14 - "100.64.0.3" "python-requests/2.32.5" "9f39d223-a58f-4eaa-a34f-d1c424209495" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:51570 10.132.0.29:443 100.64.0.3:34770 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-11T21:22:41.978Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 10 - "100.64.0.4" "python-requests/2.32.5" "9e579cc9-24e9-4deb-87d8-2f5d1b8ec298" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:40888 10.132.0.29:443 100.64.0.4:34112 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-11T21:22:42.003Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "0294f9d3-925a-4bab-a61e-297d9a03cf48" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:51570 10.132.0.29:443 100.64.0.2:9434 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-11T21:22:42.025Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "4bfff58f-8093-46ac-97ae-0445f65603e8" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:40888 10.132.0.29:443 100.64.0.3:34782 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-11T21:22:42.054Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.134.0.37" "Go-http-client/1.1" "5798a3a8-a665-4e6e-a888-67554235fa2c" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:51584 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2
[2026-05-11T21:22:42.048Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 17 - "100.64.0.4" "python-requests/2.32.5" "9491de0b-b010-4908-b68f-33f9ca421046" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.4:34116 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-11T21:22:50.995627Z	info	ads	ADS: new connection for node:6
2026-05-11T21:22:50.999760Z	info	cache	read certificate from file	resource=file-root:system
2026-05-11T21:22:57.735852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.735905Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.741059Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.741187Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.741407Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.745255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:57.745329Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:22:57.745345Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.109813Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:58.109859Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:58.110841Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:58.110881Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:22:58.128515Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.128557Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.129399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.129433Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.149255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.149290Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.156117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.156246Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.156504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.156544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.158117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.158147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.158402Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.159327Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:22:58.159457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:22:58.159472Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:22:57.734Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 10 - "100.64.0.3" "python-requests/2.32.5" "c48709d2-4692-4345-98d8-4801bce9c8cb" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.3:50868 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:22:58.108Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "21db3b13-c699-460b-8423-7b6ce44b52d7" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.29:443 100.64.0.2:57884 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-05-11T21:22:58.127Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 1 - "100.64.0.3" "python-requests/2.32.5" "91a87c5a-e79b-42e6-979e-556f600a0067" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.29:443 100.64.0.3:21582 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-05-11T21:22:58.148Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 -  - "-" 83 98 11 - "100.64.0.4" "python-requests/2.32.5" "9855ddd2-b4c1-4a8f-b9b3-8ef49f93c23e" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.29:443 100.64.0.4:7944 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-05-11T21:23:25.352Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 1267 - "-" "-" "-" "-" "-" - - 10.132.0.29:443 100.64.0.2:63558 44.207.34.38 -
2026-05-11T21:23:35.819600Z	info	ads	ADS: "" 6 terminated with stream closed
2026-05-11T21:23:38.166461Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.166507Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.171989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.172131Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.172339Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.184528Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.184612Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:23:38.184626Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.227544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.227582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.231492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.231598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.233829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.233875Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.240033Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.240189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.240308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.241812Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.241881Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:23:38.241897Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.243570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.243638Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-11T21:23:38.243650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.293768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.293817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.300699Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.300852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.301141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.301180Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.303132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.303163Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.303383Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.305047Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.305213Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.305413Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.305901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.341122Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.341157Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.347942Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.348098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.348345Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.348375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.348873Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.348895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.349124Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.352212Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.352367Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.352550Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.352977Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.378339Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.378370Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.384866Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385000Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385259Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385288Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385746Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.385969Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.387790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.387935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.388134Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.388591Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.410930Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.410982Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.417564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.417727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.417987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.418053Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.418513Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.418546Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.418769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.420343Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.420510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.420707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.421141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.445867Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.445901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.452133Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.452268Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.452504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.452533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.453000Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.453041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.453248Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.455041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.455184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.455359Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.455769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.478145Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.478176Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.484264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.484399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.484622Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.484649Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.485094Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.485117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.513216Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.513249Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.519853Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.519983Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.520229Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.520258Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.520675Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.520700Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.547556Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.547590Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.554156Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.554288Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.554525Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.554555Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.555024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.555049Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-11T21:23:38.165Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 321 19 - "100.64.0.3" "curl/7.76.1" "3e1cb350-5722-496e-88c6-592189159942" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.3:12244 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:23:38.233Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.37" "Go-http-client/1.1" "f1753fcb-9769-450c-873d-03fb83546d90" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 10.134.0.37:57136 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-11T21:23:38.226Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 17 - "100.64.0.4" "curl/7.76.1" "09352d80-c0bc-9734-b140-730b816318c3" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:48940 10.132.0.29:443 100.64.0.4:39082 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-11T21:23:38.293Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 355 12 - "100.64.0.4" "curl/7.76.1" "66dd1d00-bf42-4ccb-ad37-8a928c16d206" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 100.64.0.4:44454 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.340Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 360 12 - "100.64.0.2" "curl/7.76.1" "763285e3-af51-4b52-a749-8de425df0487" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:35078 10.132.0.29:443 100.64.0.2:5662 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.377Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 363 10 - "100.64.0.3" "curl/7.76.1" "e0b332bf-410f-4dec-baf6-61a683a4fa60" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:35078 10.132.0.29:443 100.64.0.3:12252 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.410Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 453 10 - "100.64.0.4" "curl/7.76.1" "2e8063bd-92fb-4d24-9b71-5a13b2da6e88" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 100.64.0.4:44466 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.445Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 336 10 - "100.64.0.2" "curl/7.76.1" "677e2412-76cc-9f4f-a408-07ee8dc6bb0b" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:35078 10.132.0.29:443 100.64.0.2:10256 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.477Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "20d7f400-a7f1-48b5-969c-5ff99a572838" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:35078 10.132.0.29:443 100.64.0.2:5666 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.512Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "0f493f22-b3ac-418e-9c6f-8438f85c55bc" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 100.64.0.3:30304 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.547Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "7d5eb2bf-ae86-4487-bbd9-f436b57ab6ba" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:35090 10.132.0.29:443 100.64.0.3:12254 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
2026-05-11T21:23:38.577239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.577273Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584461Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584948Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.584971Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.612236Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.612269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.619133Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.619264Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.619506Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.619536Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.619981Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.620003Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.643893Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.643929Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.650583Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.650718Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.650962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.650991Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.651457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.651480Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-11T21:23:38.674326Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.674360Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.675178Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.675209Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.697405Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.697440Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.701628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.701728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.707774Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-11T21:23:38.707836Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-11T21:23:38.707848Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-11T21:23:38.576Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "7dfa669a-18b6-42ab-a3ab-a5ee805991a3" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.29:50762 10.132.0.29:443 100.64.0.4:44470 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.611Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.2" "curl/7.76.1" "6ec04d79-1325-401a-9463-583785b6bf6e" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 100.64.0.2:5670 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.643Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "23ed2498-3883-4fcf-9139-0fcbb4b5fd29" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 100.64.0.3:12260 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.673Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 -  - "-" 100 0 1 - "100.64.0.4" "curl/7.76.1" "68615865-dbe4-9799-adc0-7191d9276e4a" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.29:443 100.64.0.4:44474 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-05-11T21:23:38.696Z] "DELETE /v1/api-keys/00e7aa3c-f13f-4b63-b235-71f74120838c HTTP/2" 200 - via_upstream - "-" 0 334 11 - "100.64.0.2" "curl/7.76.1" "49756558-905e-49fc-b842-68ab940e3c5f" "maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.29:50328 10.132.0.29:443 100.64.0.2:5676 maas.apps.ab3f1da1-f40f-4bcd-a135-962e115304ec.prod.konfluxeaas.com opendatahub.maas-api-route.1