2026-05-27T20:38:39.534166Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.534287Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.534390Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.534466Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.534867Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.534898Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.534914Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.537469Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.537494Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.537563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:38:39.537573Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.537589Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:38:39.537596Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:39.541111Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.541235Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.541336Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.541414Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.542932Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.542955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.542993Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:38:39.543003Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.543016Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:38:39.543023Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.544148Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:38:39.544200Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:38:39.544212Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:38:39.526Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.133.0.29" "Go-http-client/1.1" "d70f856e-439f-4457-a9a2-e4afebe954c0" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.58:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:48896 10.134.0.51:443 10.133.0.29:47442 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.premium-simulated-simulated-premium-kserve-route.2
[2026-05-27T20:38:39.534Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.29" "Go-http-client/1.1" "807021cf-f5a7-422c-b844-17aac9b102cb" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:38:39.519Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 928 24 - "100.64.0.2" "python-requests/2.32.5" "c034ae16-7dfd-43ee-afb6-10fc62a422a8" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.2:20866 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:38:52.992609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:52.992682Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:52.999424Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:52.999548Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:52.999791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:53.004184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:38:53.004245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:38:53.004257Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:38:52.991Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 92 334 12 - "100.64.0.3" "python-requests/2.32.5" "ed24adb0-b680-4cb4-82e0-b2e89adb5ca7" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.3:51432 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:01.031036Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.031084Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.034711Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.034836Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.037089Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.037130Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.037329Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.037368Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.044136Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.044276Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.044397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.052463Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.052598Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.052753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.055108Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.055169Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:39:01.055180Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:01.058291Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.058358Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:01.058374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.060944Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:01.061011Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:01.061028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:39:01.036Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 18 - "10.133.0.29" "Go-http-client/1.1" "802183b8-376a-9ca2-a255-6d8926acbd50" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:53518 10.134.0.51:443 10.133.0.29:47442 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:39:01.036Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 22 - "10.133.0.29" "Go-http-client/1.1" "0b8ab031-f9c0-4c4b-9dd9-9ca9947d2c3f" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:49536 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-27T20:39:01.029Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 813 31 - "100.64.0.4" "python-requests/2.32.5" "a37d6e44-ade4-4b8b-9b7d-1bf3223b52dd" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.4:10536 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:17.244893Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:17.244939Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:17.250906Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:17.251027Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:17.253402Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.253446Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.263371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.263512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.266434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.266495Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:17.266507Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.268768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.268798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.278238Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.278344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.279957Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.280005Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:17.280016Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.281248Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.281278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.290164Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.290267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.291762Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.291806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:17.291817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:17.292879Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:17.292947Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:39:17.292960Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:39:17.252Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 14 - "10.133.0.29" "Go-http-client/1.1" "b21743e0-ae1f-4a42-9b75-be481c0cbad6" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:45868 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:39:17.267Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.133.0.29" "Go-http-client/1.1" "f7604c97-381f-4a90-b952-88b1955f9a03" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:49536 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-27T20:39:17.280Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.133.0.29" "Go-http-client/1.1" "76a018d3-946f-4203-98a0-950d1d9f72c0" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:39:17.243Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1351 49 - "100.64.0.3" "python-requests/2.32.5" "d6a81bf2-d6b0-4263-90ed-765a2b76371b" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.3:34794 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:34.791989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.792042Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.797661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.797783Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.800081Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.800114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.800129Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.809445Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.809559Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.809650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.811236Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.811259Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.811303Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:34.811313Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.811325Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:34.811331Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.812474Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:34.812523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:34.812533Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:39:34.799Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.29" "Go-http-client/1.1" "ff4163cf-6904-40eb-b300-3a3bdc13e202" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:39:34.790Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 477 21 - "100.64.0.2" "python-requests/2.32.5" "250d52c0-5dce-42a0-9399-e847fec04916" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.2:5178 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:45.992348Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:45.992397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:45.999269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:45.999399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:45.999616Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:46.005145Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:46.005207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:39:46.005218Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:39:45.991Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 14 - "100.64.0.2" "python-requests/2.32.5" "4442b064-a96e-41e8-975a-7a4fcbf9df53" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:61116 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:54.036858Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:54.036905Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:54.040485Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:54.040608Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:54.042485Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:39:54.042542Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:39:54.042552Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:39:54.035Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 6 - "100.64.0.4" "python-requests/2.32.5" "a0c12d03-ce8c-4d80-8c91-061421e4e1cf" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:1262 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:39:54.666047Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.666101Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.671667Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.671801Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.672014Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.675525Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:39:54.675584Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:39:54.675594Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:39:54.664Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 10 - "100.64.0.4" "python-requests/2.32.5" "4e71e1ab-eab0-44c6-971d-d885687c3e1b" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.4:46432 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:02.702747Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.702794Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.706221Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.706354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.708502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.708546Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.715751Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.715921Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.716033Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.717609Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.717696Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:02.717713Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.718798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:02.718857Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:02.718873Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:03.107350Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.107399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.113250Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.113368Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.113563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.116879Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:03.116935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:40:03.116946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:40:02.707Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.29" "Go-http-client/1.1" "7efe4590-f3e1-4c54-b944-c8ee15a3f160" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:40:02.701Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.3" "python-requests/2.32.5" "92352783-e575-48c2-b4dd-121f74b2cd63" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.3:29556 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-27T20:40:03.106Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 318 10 - "100.64.0.2" "python-requests/2.32.5" "f122a2e8-45a9-4967-b6d7-c14b4e91fa57" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:62836 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:11.141570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.141669Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.145614Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.145777Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.148102Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.148139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.154807Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.154959Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.155082Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.156826Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.156888Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:11.156899Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:11.158205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.158265Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:40:11.158277Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:40:11.147Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.29" "Go-http-client/1.1" "9bc2d97a-fef9-43fc-b091-be7f9a4c3a2d" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:40:11.139Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 18 - "100.64.0.4" "python-requests/2.32.5" "e8e54ae6-4c34-44c4-822f-08ad32d2990f" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:37348 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:11.918663Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.918709Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.924569Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.924729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.924934Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.928307Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:11.928364Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:40:11.928375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:40:11.917Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 10 - "100.64.0.3" "python-requests/2.32.5" "47378386-a4c8-4b56-b15a-de031dc0c5d6" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.3:54362 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:19.958495Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.958545Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.961996Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.962115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.964257Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.964298Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.964316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.970284Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.970403Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.970501Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.970576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.972202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.972226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.972269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:19.972289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.972304Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:19.972312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.973391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:19.973440Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:19.973450Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:40:19.963Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.133.0.29" "Go-http-client/1.1" "51e89194-8ce4-4137-9ff4-c1dad1a44ef4" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:52022 10.134.0.51:443 10.133.0.29:45688 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:40:19.957Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 16 - "100.64.0.3" "python-requests/2.32.5" "c626e91a-24f2-4b4e-8a96-34196812a519" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.3:45758 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:29.174841Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.174896Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.180497Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.180644Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.180841Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.184554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:40:29.184643Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:40:29.184656Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:40:29.173Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 327 10 - "100.64.0.2" "python-requests/2.32.5" "30737e04-e35f-44e1-ad82-9b045250db5e" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.2:42648 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:40:45.462994Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:45.463049Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:45.467423Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:45.467547Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:45.469893Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:40:45.469955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:40:45.469966Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:40:45.461Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.4" "python-requests/2.32.5" "561e01ee-2cfc-47ff-bf5b-c8a0e7700244" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:29908 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:41:02.570569Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:02.570647Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:02.576187Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:02.576344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:02.578473Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:02.578546Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:41:02.578563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:41:02.569Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.3" "python-requests/2.32.5" "1edb3e76-f364-4561-8573-c7188bb2519b" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.3:58868 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:41:19.778760Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:19.778807Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:19.785132Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:19.785251Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:19.787309Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:19.787363Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:41:19.787374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:41:19.777Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 9 - "100.64.0.2" "python-requests/2.32.5" "83b0eab6-39a6-453b-848b-ef3c8ae18b7d" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:21278 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:41:37.225814Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:37.225874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:37.231115Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:37.231240Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:37.233371Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:37.233432Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:41:37.233444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:41:37.224Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.4" "python-requests/2.32.5" "df5a9ce6-8361-4310-bbf1-704299533035" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.4:37108 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:41:49.260381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.260428Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.266923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.267069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.267334Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.271857Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:41:49.271923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:41:49.271934Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:41:49.259Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 12 - "100.64.0.3" "python-requests/2.32.5" "0acbcf2a-1b20-4039-b360-24f50de5122a" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.3:23074 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:41:57.305061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.305122Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.319597Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.319787Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.330489Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.330532Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.337512Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.337677Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.337795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.339260Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.339328Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:41:57.339344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.340423Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:41:57.340485Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:41:57.340502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:41:57.329Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.133.0.29" "Go-http-client/1.1" "f5d6f2c6-3231-4b84-88c5-00db097f4d42" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:53518 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:41:57.303Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 36 - "100.64.0.2" "python-requests/2.32.5" "f007c0a3-aadc-4c5b-b5fc-821ddf320574" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:25954 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:42:09.589563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.589641Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.595859Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.596002Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.596224Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.600350Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.600422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:09.600438Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.619464Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.619500Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.624781Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.624886Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.625059Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.628417Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:09.628477Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:09.628490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:42:09.588Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 12 - "100.64.0.2" "python-requests/2.32.5" "5ccd921c-6f8d-418d-961c-29df16dd3f67" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:15898 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-27T20:42:09.618Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 9 - "100.64.0.4" "python-requests/2.32.5" "a39d1a24-4508-4423-8113-b802efb260ef" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:7448 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:42:17.654147Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.654205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.657875Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.657999Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.660220Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.660254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.666017Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.666168Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.666283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.667655Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.667726Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:17.667743Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.668797Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.668860Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:17.668876Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.686397Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.686435Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.689327Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.689444Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.691426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.691465Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.697043Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.697176Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.697283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.701241Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.701304Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:17.701320Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.703212Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:17.703273Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:17.703289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:42:17.659Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "10.133.0.29" "Go-http-client/1.1" "2d13ae39-55ff-4c1c-949d-447d08a70be0" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:53518 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:42:17.653Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 15 - "100.64.0.3" "python-requests/2.32.5" "1518a959-59a4-47be-a14e-23295e7c599c" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.3:59248 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-27T20:42:17.690Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.133.0.29" "Go-http-client/1.1" "ef1e8f38-b3a3-4207-9b32-ae9f4ba4fb3c" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:40160 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-27T20:42:17.685Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 17 - "100.64.0.2" "python-requests/2.32.5" "ecb74683-44de-40a2-b673-d0bdaba57311" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:52592 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:42:34.485690Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:42:34.485747Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:42:34.492482Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:42:34.492618Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:42:34.495142Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.495182Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.509412Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.509541Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.510984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.511041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:34.511052Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.512415Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.512447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.523482Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.523589Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.525183Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.525233Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:34.525244Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.526439Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.526471Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.537007Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.537112Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.538589Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.538652Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:34.538663Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:34.539829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:42:34.539889Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:42:34.539902Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:42:34.494Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 16 - "10.133.0.29" "Go-http-client/1.1" "59c33d3f-f709-44f4-87d9-988cf9642d85" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:53518 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:42:34.511Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 13 - "10.133.0.29" "Go-http-client/1.1" "0b1f4f92-d998-4b45-9ead-a90951d2ec6a" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:40160 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-27T20:42:34.525Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.29" "Go-http-client/1.1" "5db33f67-1ae2-4b42-b329-3f0ade8156b6" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:56712 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:42:34.484Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 55 - "100.64.0.4" "python-requests/2.32.5" "7ab245ab-a42e-42e6-bcd6-44658a1ab9d4" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.4:11498 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-27T20:42:38.565Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 2 - "-" "-" "-" "-" "-" - - 10.134.0.51:443 100.64.0.3:29970 www.metamox.com -
[2026-05-27T20:42:43.074Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.134.0.51:443 100.64.0.2:41170 www.metamox.com -
2026-05-27T20:42:51.520813Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.520870Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.527703Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.527862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.530673Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.530717Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.541849Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.542023Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.543661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.543740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:51.543757Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.544894Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.544962Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:51.544979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.567022Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.567086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:42:51.529Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 14 - "10.133.0.29" "Go-http-client/1.1" "afb207f1-4afd-4acc-8ab6-7281fea4c89c" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.134.0.57:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:53518 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-05-27T20:42:51.519Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 25 - "100.64.0.4" "python-requests/2.32.5" "5419f132-944a-42c5-a9ac-ef8f69f980e6" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:54124 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:42:51.573988Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.574152Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.576373Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.576416Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.587577Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.587774Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.589527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.589593Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:51.589605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.590727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:42:51.590780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:42:51.590791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:42:51.575Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 14 - "10.133.0.29" "Go-http-client/1.1" "97001abc-feab-4c85-8503-436f5196371e" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:40160 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-05-27T20:42:51.565Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 25 - "100.64.0.3" "python-requests/2.32.5" "42c69952-f390-48fe-856f-9013f75c993a" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.3:58002 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:43:00.737818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:00.737872Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:00.739008Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:00.739042Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:43:00.736Z] "GET /maas-api/v1/models HTTP/1.1" 401 -  - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "9a4b9d1c-4e7d-4ccf-990d-aa82e2538576" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.51:443 100.64.0.4:21632 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:43:17.497254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.497313Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.504137Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.504314Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.504601Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.509818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.509903Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:43:17.509919Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.530987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.531046Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.538824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.538963Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.539300Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.539338Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.540735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.540763Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.541016Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.542855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.542995Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.543182Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.543779Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.560012Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.560053Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.566667Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.566794Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.567090Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.567129Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.567581Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.567608Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:43:17.496Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 13 - "100.64.0.2" "python-requests/2.32.5" "19012838-f781-462a-b3f1-b65444aff58f" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.2:15450 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-05-27T20:43:17.530Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 13 - "100.64.0.3" "python-requests/2.32.5" "e1176397-0bba-429b-9050-50385dd26085" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:41056 10.134.0.51:443 100.64.0.3:22468 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-27T20:43:17.559Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 8 - "100.64.0.4" "python-requests/2.32.5" "9ea76507-91e9-4f63-9d21-4f8e7cc5d482" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:41056 10.134.0.51:443 100.64.0.4:6268 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
2026-05-27T20:43:17.590100Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.590148Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.596854Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.596984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.597283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.597316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.597756Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.597784Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.616956Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.617001Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.620114Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.620232Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.622938Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.622972Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.628488Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.628635Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.628743Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.630266Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.630324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:43:17.630334Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.631848Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:17.631900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:43:17.631911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:43:17.589Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 8 - "100.64.0.2" "python-requests/2.32.5" "bd74b1e2-538e-4966-a4e4-cce8461372e3" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.51:443 100.64.0.2:5154 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-05-27T20:43:17.622Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "10.133.0.29" "Go-http-client/1.1" "5052af70-8b98-4b81-aef6-fd0edcebd754" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.132.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.51:32936 10.134.0.51:443 10.133.0.29:45508 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2
[2026-05-27T20:43:17.615Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.4" "python-requests/2.32.5" "b41cb0b1-3987-43d7-841b-08ac579ddc04" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:35990 10.134.0.51:443 100.64.0.4:26324 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:43:26.595364Z	info	ads	ADS: new connection for node:6
2026-05-27T20:43:26.597606Z	info	cache	read certificate from file	resource=file-root:system
2026-05-27T20:43:33.441886Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.441936Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.447458Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.447617Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.447869Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.452060Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.452120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-05-27T20:43:33.452131Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-05-27T20:43:33.440Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 11 - "100.64.0.3" "python-requests/2.32.5" "c5adeb19-a00b-4e6e-a513-868437a60dc7" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "10.133.0.29:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.51:49000 10.134.0.51:443 100.64.0.3:33292 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-05-27T20:43:33.844029Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.844079Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.845184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.845221Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.863523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.863567Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.864478Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.864509Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-05-27T20:43:33.882806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.882847Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.889582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.889735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.890045Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.890079Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.891290Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.891314Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.891554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.892657Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-05-27T20:43:33.892780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-05-27T20:43:33.892791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-05-27T20:43:33.842Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "d2b50e7a-e185-4ba2-8bde-6a43317c2848" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.51:443 100.64.0.3:58028 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-05-27T20:43:33.862Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "0649b2cf-7ee6-414b-b170-9aabd4d90e5c" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.51:443 100.64.0.2:31354 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-05-27T20:43:33.881Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 -  - "-" 83 98 11 - "100.64.0.4" "python-requests/2.32.5" "41a0d80f-7ace-4a96-bc40-f861cf0ebca8" "maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.51:443 100.64.0.4:41498 maas.apps.95363914-011e-4558-bad6-94a341a69916.prod.konfluxeaas.com llm.e2e-external-model.0
2026-05-27T20:44:11.678715Z	info	ads	ADS: "" 6 terminated