2026-06-05T15:00:58.872516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:00:58.854Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 17 - "100.64.0.2" "python-requests/2.32.5" "64ac664b-ae74-4e29-b0d0-f144eb6a24e7" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:58756 10.132.0.37:443 100.64.0.2:46208 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:01:12.945588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.945637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.961132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.961292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.961516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.964645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:12.964709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:12.964720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:01:12.943Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 20 - "100.64.0.4" "python-requests/2.32.5" "ef73f643-eb98-4c23-9aa0-0d0e4bd2560a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.4:44442 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:01:20.998370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:20.998420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:21.012025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:21.012172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:21.023746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.023791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.030295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.030419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.030529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.032071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.032134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:21.032144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:21.033303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:21.033360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:01:21.033371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:01:21.022Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.134.0.45" "Go-http-client/1.1" "a13b6dc4-b291-4862-a8a5-3c2e66111db7" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:54798 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T15:01:20.996Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 36 - "100.64.0.4" "python-requests/2.32.5" "06ae1834-6aee-47a0-afe6-3a1eb7c086c6" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:58756 10.132.0.37:443 100.64.0.4:21716 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:01:35.214150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.214234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.230579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.230730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.230995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.235843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.235925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:01:35.235936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:01:35.255276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.255327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.265555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.265714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.265958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.269350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:35.269426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:35.269442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:01:35.211Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 24 - "100.64.0.3" "python-requests/2.32.5" "d1e08fe1-48f9-40e4-ad3d-eacfc7f4a262" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:58756 10.132.0.37:443 100.64.0.3:47774 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:01:35.253Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 15 - "100.64.0.2" "python-requests/2.32.5" "cc7ed0d8-0eee-42a0-aba6-790453917c2a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.2:47300 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:01:43.296524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.296578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.300369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.300495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.302884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.302921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.309112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.309247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.309346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.310786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.310848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:43.310859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.311936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.311997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:43.312008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.337416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.337457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.340395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.340506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.342683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.342714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.348697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.348804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.348898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.351968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.352026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:43.352036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.353758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:01:43.353810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:01:43.353821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:01:43.301Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.134.0.45" "Go-http-client/1.1" "bd69d542-f55f-4a65-a6df-27775f60aa59" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:54798 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T15:01:43.294Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 17 - "100.64.0.3" "python-requests/2.32.5" "410feeab-c087-41bd-bb51-552aeebfe777" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.3:4210 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:01:43.341Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.134.0.45" "Go-http-client/1.1" "45ad027c-02c8-4951-b116-d82c1493204f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:37716 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T15:01:43.336Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 17 - "100.64.0.4" "python-requests/2.32.5" "f0e14d56-fa79-4568-be0d-d8a621ae3493" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.4:54670 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:02:00.025658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.025705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.039492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.039635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.042733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.042776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.052738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.052896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.054472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.054540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:00.054552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.056434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.056470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.066163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.066316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.067712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.067771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:00.067781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.069565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.069598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.079956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.080087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.081497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.081558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:00.081568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.082690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:00.082752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:00.082764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:02:00.041Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 13 - "10.134.0.45" "Go-http-client/1.1" "45abf90b-093d-4622-aedb-9ab1a83cabd3" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:54798 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T15:02:00.055Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.134.0.45" "Go-http-client/1.1" "fa295f4d-3150-4087-b00b-72fdadce6a3f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:37716 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T15:02:00.068Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 13 - "10.134.0.45" "Go-http-client/1.1" "494bf96b-6ebf-4a47-8d24-804bfab2ac1f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:02:00.023Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 58 - "100.64.0.3" "python-requests/2.32.5" "7bee31e0-b4bb-4e2a-972b-085ddd22fba7" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.3:60286 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:02:14.496985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.497034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.510700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.510840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.513918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.513952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.523646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.523767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.525185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.525274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:14.525286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.526616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.526670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:14.526680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.542990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:14.543032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:14.552654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:14.552807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:14.555339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.555374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.564333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.564474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.565852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.565912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:14.565922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:14.566947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:14.567014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:02:14.567030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:02:14.512Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.134.0.45" "Go-http-client/1.1" "4ad8d9df-49be-4f1f-8de4-438723242cbe" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:54798 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.3 [2026-06-05T15:02:14.495Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 31 - "100.64.0.2" "python-requests/2.32.5" "5638c316-21d5-41e8-b044-53ef23cd2e71" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.2:61506 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:02:14.554Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.134.0.45" "Go-http-client/1.1" "2ceb1114-7978-4a8b-847f-8973a877362f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.48:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:37716 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.3 [2026-06-05T15:02:14.541Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 25 - "100.64.0.4" "python-requests/2.32.5" "ed591734-adf7-42f1-a37b-13076ba5e0e5" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:58756 10.132.0.37:443 100.64.0.4:35550 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:02:23.612964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:23.613011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:23.614325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:23.614357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:02:23.611Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 3 - "100.64.0.2" "python-requests/2.32.5" "b8141f5a-6055-4731-9f8f-57886533fb19" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.37:443 100.64.0.2:9402 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:02:40.263672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.263720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.279077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.279236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.279464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.284636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.284702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:40.284713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.307489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.307533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.314734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.314853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.315128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.315160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.316599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.316625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.316854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.319477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.319606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.319784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.320336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.337996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.338033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.344859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.344988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.345280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.345312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.345812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.345837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.366523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.366568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.373933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.394796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:40.394837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:40.397840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:40.397941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:40.400720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.400761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.406494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.406605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.406701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.408333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.408391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:40.408402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:40.409852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:02:40.409910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:02:40.409921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:02:40.261Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 22 - "100.64.0.3" "python-requests/2.32.5" "5b56b5bd-8db9-4b6b-b039-41472d158a96" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.3:50646 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:02:40.306Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 14 - "100.64.0.2" "python-requests/2.32.5" "1abbffe0-7256-4c1c-b50a-34ef1e75d2a5" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:49574 10.132.0.37:443 100.64.0.2:49112 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-05T15:02:40.336Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 9 - "100.64.0.4" "python-requests/2.32.5" "6027c980-d249-44fe-b925-7b96ed2ea8d0" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:49574 10.132.0.37:443 100.64.0.4:20522 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-05T15:02:40.365Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.3" "python-requests/2.32.5" "e9774be4-d51c-4242-83f2-aebc677e60e6" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.37:443 100.64.0.3:50650 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-06-05T15:02:40.399Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.45" "Go-http-client/1.1" "15a3360e-f305-4054-a0f3-90b97f2a1089" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:60630 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:02:40.393Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.4" "python-requests/2.32.5" "d8235137-6d2c-4235-9905-f660725eadbb" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:58756 10.132.0.37:443 100.64.0.4:25212 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:02:49.255256Z info ads ADS: new connection for node:6 2026-06-05T15:02:49.257620Z info cache read certificate from file resource=file-root:system 2026-06-05T15:02:53.956296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.956342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.969395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.969534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.969757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.975378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:53.975452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:53.975463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.351132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.351180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.352124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.352155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.374783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.374824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.375742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.375774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.392933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.392972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.400383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.400517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.400800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.400841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.402364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.402397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.402632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.403609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:02:54.403733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:02:54.403748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:02:53.953Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 21 - "100.64.0.2" "python-requests/2.32.5" "b805af62-5e8e-4816-8824-e53c733c5268" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:60278 10.132.0.37:443 100.64.0.2:15368 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:02:54.349Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "a4a09542-6775-4855-b561-60223df00af0" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.37:443 100.64.0.3:60082 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-05T15:02:54.373Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "46b7030a-074a-4329-a979-f219ba7aba0a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.37:443 100.64.0.2:5264 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-06-05T15:02:54.391Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 12 - "100.64.0.4" "python-requests/2.32.5" "cdeb6e03-346d-48a7-9580-c512654e8a5f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.37:443 100.64.0.4:39696 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.e2e-external-model.0 2026-06-05T15:03:32.072885Z info ads ADS: "" 6 terminated 2026-06-05T15:04:01.225783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.225838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.228628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.228761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.228961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.242852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.242936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:01.242952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.327261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:01.327314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:01.364466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:01.364517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:01.393362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.393415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.394871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.394912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.427544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.427593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.428953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.428996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.775809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.775864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.778417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.778546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.778752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.782038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:01.782117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:01.782133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:04:01.224Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 18 - "100.64.0.4" "python-requests/2.32.5" "a4c2cbdd-b310-40b0-ba0b-49353604367a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.4:22384 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:01.325Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 37 0 39 - "100.64.0.3" "python-requests/2.32.5" "034f066c-6802-4a61-b7d4-67e1507dc664" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.37:443 100.64.0.3:36380 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:01.391Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 35 0 3 - "100.64.0.3" "python-requests/2.32.5" "1b47e139-04ab-4d99-bb1a-009f64d7cf86" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.37:443 100.64.0.3:55786 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:01.425Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 36 0 3 - "100.64.0.2" "python-requests/2.32.5" "e21d2f5d-423c-444c-bf6f-11c0a8afce5f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.37:443 100.64.0.2:28702 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:01.774Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 8 - "100.64.0.2" "python-requests/2.32.5" "0653b864-8ff4-4432-855f-01cd2124787f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.2:60642 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:04:02.001275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.001321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.004027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.004141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.004341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.008809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.008873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:02.008884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.025722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.025766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.038025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.038162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.040718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.040755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.046837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.046967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.047071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.049465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.049530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:02.049540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.050765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.050821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:02.050832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.071961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.072006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.078375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.078527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.078812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.078855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.080387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.080419Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.080658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.082416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.082565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.082752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.083308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:02.162229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.162272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.165033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.165147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.165362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.168435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.168494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:02.168504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.200398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.200440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.203028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.203136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.206876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:02.206941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:02.206956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:04:01.999Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 9 - "100.64.0.4" "python-requests/2.32.5" "12b7f710-2503-4e2f-acd0-d87abdcfe79a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.4:22400 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:02.039Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.134.0.45" "Go-http-client/1.1" "ffb1e776-155b-42bf-821f-4ffc0ce927ff" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:04:02.024Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 26 - "100.64.0.3" "python-requests/2.32.5" "d69b8611-5c7a-468f-98a7-a8f011b45154" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.3:55790 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:02.070Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 323 12 - "100.64.0.2" "python-requests/2.32.5" "92d64dc2-8ac6-4ff7-937c-f80b4dfa927a" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 100.64.0.2:28716 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-05T15:04:02.160Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "8c1d1942-135d-42bb-8199-9aa73537f6ab" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.4:22414 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:02.198Z] "DELETE /v1/api-keys/0e7dcde6-f772-4636-8365-e5688d2aae47 HTTP/1.1" 200 - via_upstream - "-" 0 251 8 - "100.64.0.4" "python-requests/2.32.5" "579f70f5-8a96-4bdb-817f-8392e28433e5" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.4:14592 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:04:05.230767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.230817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.234175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.234287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.236066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.236125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.236136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.358442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.358487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.378293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.378342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.513457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.513502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.516010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.516122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.516322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.519677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.519738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.519749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.535830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.535868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.538282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.538379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.538534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.541556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.541608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.541618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.622606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.622651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.625153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.625275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.625455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.628747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.628805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.628816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.650149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.650213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.652917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.653027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.656509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.656571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.656581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.672752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.672796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.675299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.675423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.677399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.677463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:05.677478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.755851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.755907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.758417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.758527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.758730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.762005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.762063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.762074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.779788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.779837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.783056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.783162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.785590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.785629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.791302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.791443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.791550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.793149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.793239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:05.793254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.794438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.794506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.794521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.873704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.873749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.876337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.876445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.876621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.879838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.879906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.879918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.897317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.897353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-06-05T15:04:05.229Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 7 - "100.64.0.3" "python-requests/2.32.5" "8b2cdd6a-f4e4-40ac-8041-b3a4aa87697f" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.3:55806 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.356Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 - - "-" 38 0 21 - "100.64.0.3" "python-requests/2.32.5" "a5715d5c-217d-45d9-bce6-da4af10b768c" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.37:443 100.64.0.3:55928 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.511Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 8 - "100.64.0.2" "python-requests/2.32.5" "01d523bb-eaa7-4438-bbd8-1cc632d3725b" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.2:28720 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.534Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 316 7 - "100.64.0.4" "python-requests/2.32.5" "00422543-e801-4bc9-8a21-72087e21cc08" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.4:22428 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.620Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 8 - "100.64.0.3" "python-requests/2.32.5" "353c5ed1-db52-47a6-a80e-f062adc69c32" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.3:55808 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.648Z] "DELETE /v1/api-keys/e3c21a89-b852-4c29-b6a9-91572749cfbf HTTP/1.1" 200 - via_upstream - "-" 0 253 8 - "100.64.0.2" "python-requests/2.32.5" "10035458-b1c1-4784-8122-eeb7f29a4b27" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.2:5988 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.671Z] "DELETE /v1/api-keys/e3c21a89-b852-4c29-b6a9-91572749cfbf HTTP/1.1" 404 - via_upstream - "-" 0 29 6 - "100.64.0.4" "python-requests/2.32.5" "84ce194c-6587-4087-a443-b20a02288c8c" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.4:25148 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.754Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 7 - "100.64.0.2" "python-requests/2.32.5" "7f10fdda-3967-4ae8-889a-51dbdf78eaab" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.2:28734 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.784Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.45" "Go-http-client/1.1" "36804c26-12ec-42d1-9c74-d3428e7a9114" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:04:05.778Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.3" "python-requests/2.32.5" "cc7bff46-7b4e-48a9-993e-df22868fb487" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.3:55940 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.871Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.4" "python-requests/2.32.5" "5803e26c-bbd5-41bf-89cd-dc8ea6960a40" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.4:22444 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-05T15:04:05.900285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.900392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.902080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.902132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:05.902142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:05.919673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.919717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.922529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.922644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.925065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.925102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.930873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.931013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.931112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.932722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.932787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:05.932802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.933823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:05.933886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:05.933901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.010878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.010931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.013571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.013695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.013890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.017094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.017165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:06.017180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.034096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.034142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.037107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.037257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.039570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.039608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.045271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.045413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.045523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.047027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.047095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:06.047110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.048179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.048274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:06.048290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.064862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.064908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.067649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.067764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.069911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.069948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.075593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.075732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.075844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.077305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.077370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:06.077385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.081128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.081192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-06-05T15:04:06.081224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-06-05T15:04:06.158933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.158979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.161663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.161782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.161996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.165357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-06-05T15:04:06.165420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-06-05T15:04:06.165430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-06-05T15:04:05.895Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 6 - "100.64.0.2" "python-requests/2.32.5" "56c1bf1c-8b27-4190-b531-2b4973d2a634" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.2:5990 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:05.923Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.45" "Go-http-client/1.1" "e8daf881-eeef-4d2b-aba5-7c694a64f277" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:04:05.918Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.4" "python-requests/2.32.5" "7ee9c0d8-c8cf-4a4b-a3f6-ea4dc725cb04" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.4:25154 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:06.009Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 8 - "100.64.0.3" "python-requests/2.32.5" "aa8e65f1-242a-4c7b-aa83-9d0bb2938bd7" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.3:55822 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:06.038Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.45" "Go-http-client/1.1" "36c5eb77-a376-4e02-9061-df2a3b3f5756" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:04:06.032Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 15 - "100.64.0.3" "python-requests/2.32.5" "eebbb029-a3d1-4aa1-bdb9-e8a0634ca726" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.3:55950 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:06.068Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "10.134.0.45" "Go-http-client/1.1" "36424395-43df-4642-84c4-4c6d1bb5ea25" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.37:32888 10.132.0.37:443 10.134.0.45:58832 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-05T15:04:06.063Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.2" "python-requests/2.32.5" "dfaa089f-41e9-43b5-8deb-1dadbbd49fd2" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46790 10.132.0.37:443 100.64.0.2:5992 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-05T15:04:06.157Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 320 8 - "100.64.0.4" "python-requests/2.32.5" "e9a5f97c-c8d8-4675-a045-54438606cd9d" "maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com" "10.134.0.45:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.37:46778 10.132.0.37:443 100.64.0.4:25164 maas.apps.57bf87d1-68a3-49e8-ae91-64c3ecde1439.prod.konfluxeaas.com opendatahub.maas-api-route.1