2026-05-21T19:03:24.948974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:24.948988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:03:24.937Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.36" "Go-http-client/1.1" "4601a1e3-1cca-4d0c-bf63-e4e1ced012af" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 10.132.0.36:60264 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:03:24.931Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.2" "python-requests/2.32.5" "55a1ca32-a792-4cf1-bbb2-62f3410058fe" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.2:26464 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:03:25.332954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.333006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.339188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.339337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.339631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.343101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:25.343164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:25.343175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:03:25.331Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 317 11 - "100.64.0.4" "python-requests/2.32.5" "5b2a4f2f-ebb0-43f6-8d8b-b0a0130c581f" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:61540 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:03:33.376595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.376644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.380910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.381048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.383200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.383246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.389535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.389682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.389801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.391443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.391503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:33.391513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.392640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:33.392699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:33.392709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.156593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.156641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.163853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.164002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.164239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.167554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:34.167622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:34.167633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:03:33.382Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.36" "Go-http-client/1.1" "5feb8ad3-a2f0-4cd7-8564-c9d5377fe390" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 10.132.0.36:60264 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:03:33.375Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.3" "python-requests/2.32.5" "9c5b9e94-d41d-9d09-81b5-514b1e6c0b02" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.3:47736 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:03:34.155Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 12 - "100.64.0.4" "python-requests/2.32.5" "b0940c0f-71a0-4150-9e1a-84903d547dc8" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:41570 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:03:42.199452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.199503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.203452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.203598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.205747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.205787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.205809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.211979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.212164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.212313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.212456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.213972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.213998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.214046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:42.214056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.214074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:42.214082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.215157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:03:42.215210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:03:42.215221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:03:42.204Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.36" "Go-http-client/1.1" "af6563af-bbfb-4777-8758-b3035820dad6" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 10.132.0.36:60264 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:03:42.198Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 16 - "100.64.0.2" "python-requests/2.32.5" "76f0f834-9702-46e1-8aea-18d0e0b8a43c" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.2:31078 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:03:51.404056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.404104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.410323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.410491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.410725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.414283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:03:51.414347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:03:51.414378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:03:51.402Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 11 - "100.64.0.3" "python-requests/2.32.5" "2c27ff5a-e76a-4406-8e23-5cd4c7c1b773" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.3:41242 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:04:07.702963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:07.703011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:07.707913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:07.708073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:07.709932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:07.709999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:04:07.710010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:04:07.701Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.2" "python-requests/2.32.5" "b2d2377c-1096-4162-a845-1d92d0550b31" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.2:27270 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:04:24.774983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:24.775034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:24.782135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:24.782285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:24.784151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:24.784216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:04:24.784227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:04:24.773Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 10 - "100.64.0.4" "python-requests/2.32.5" "1caecb21-34d0-4280-a847-c3f82055b86f" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:54756 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:04:42.024461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:42.024514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:42.032528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:42.032677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:42.034572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:04:42.034634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:04:42.034645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:04:42.023Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 11 - "100.64.0.3" "python-requests/2.32.5" "365fbcaa-d061-4662-8fb7-f1262d0df0ea" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.3:7332 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:04:59.473101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:59.473153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:59.478975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:59.479115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:59.480908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:04:59.480967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:04:59.480977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:04:59.471Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.2" "python-requests/2.32.5" "0e0f543b-3077-497f-8ba4-ea6f3fddd289" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.2:3732 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:05:11.453425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.453478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.461033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.461182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.461455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.465972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:11.466034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:11.466044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:05:11.452Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 13 - "100.64.0.4" "python-requests/2.32.5" "a259b339-0b13-4375-8442-c1ce47e88a5d" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:39042 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:05:19.500636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.500687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.514381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.514534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.525228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.525273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.532081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.532224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.532375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.533916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.533980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:19.533990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.535009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:19.535062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:19.535072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:05:19.524Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.132.0.36" "Go-http-client/1.1" "cd5a4388-bb1c-402a-a530-1a509ef5b66d" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:53706 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-21T19:05:19.499Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 35 - "100.64.0.3" "python-requests/2.32.5" "33a7b0d3-fa3f-4539-a350-67209eeda696" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.3:44466 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:05:33.705601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.705655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.710787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.710923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.711135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.714541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.714600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:05:33.714611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:33.739301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.739348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.744982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.745125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.745351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.748669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:33.748731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:33.748742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:05:33.704Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 10 - "100.64.0.2" "python-requests/2.32.5" "666a53e7-c5ae-4c35-ac7d-09c28c941122" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.2:57442 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:05:33.738Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 10 - "100.64.0.3" "python-requests/2.32.5" "e65ecd95-2ecd-4cdd-b10d-526f27720443" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.3:56740 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:05:41.779111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.779164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.782852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.782998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.785264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.785301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.791631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.791766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.791894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.793471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.793539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:41.793550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.794618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.794678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:41.794689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.814666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:41.814716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:41.818067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:41.818227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:41.820557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.820598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.827400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.827538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.827674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.830020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.830096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:41.830107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:41.831284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:41.831378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:05:41.831395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:05:41.784Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.132.0.36" "Go-http-client/1.1" "de0b1e8d-04b5-496d-a212-9ef9bffab886" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:53706 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-21T19:05:41.777Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 16 - "100.64.0.4" "python-requests/2.32.5" "fc606e3b-521c-4f98-8814-74a21d6aa44d" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:10592 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:05:41.819Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "10.132.0.36" "Go-http-client/1.1" "387b2516-6845-45f3-adef-3be02b9e9a7d" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.53:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:34268 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-21T19:05:41.813Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 17 - "100.64.0.4" "python-requests/2.32.5" "a028d1a6-9f16-49af-a7ca-de3fb5946363" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.4:25346 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:05:58.376535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:58.376596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:58.382823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:58.382980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:58.385446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.385481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.395143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.395292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.396823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.396887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:58.396898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.398271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.398303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.408060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.408187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.409412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.409470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:58.409480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.410822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.410852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.419747Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.419870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.422061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.422124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:05:58.422135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:05:58.423176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:05:58.423256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:05:58.423275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:05:58.384Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.132.0.36" "Go-http-client/1.1" "343fb0f8-781b-4a1c-b76a-d038c537de1a" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:53706 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-21T19:05:58.397Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.132.0.36" "Go-http-client/1.1" "cf7f08c7-17f7-43d9-b9e7-92d98dce4eed" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.53:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:34268 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-21T19:05:58.410Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.132.0.36" "Go-http-client/1.1" "1c77965c-8ad1-4ca7-a5db-71957c4b059f" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:05:58.375Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 47 - "100.64.0.2" "python-requests/2.32.5" "8b0d9f25-06f7-45a4-9244-b8e6b7a7a156" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:52112 10.133.0.44:443 100.64.0.2:36294 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:06:14.911008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.911058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.916992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.917127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.919417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.919450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.928965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.929103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.930602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.930664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:14.930675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.931767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.931822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:14.931833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.952689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.952735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.957607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.957767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.960101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.960138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.969457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.969612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.970984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.971049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:14.971060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.972111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:14.972163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:14.972174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:06:14.918Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.132.0.36" "Go-http-client/1.1" "90a072ac-3645-44a0-834f-d398521fc73c" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:53706 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-21T19:06:14.909Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 22 - "100.64.0.2" "python-requests/2.32.5" "d2cb2608-f77d-477d-b87b-4de9ec27ec50" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.2:16378 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:06:14.959Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.132.0.36" "Go-http-client/1.1" "4225a6aa-7a92-4012-a744-9d15b92dee51" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.53:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:34268 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-21T19:06:14.951Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 20 - "100.64.0.3" "python-requests/2.32.5" "e053b6e2-a44c-4dba-baf5-02f06a2c433e" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.3:37676 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:06:23.972226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:23.972276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:23.973556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:23.973588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:06:23.971Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "c9968665-e4cb-406c-9c41-b40dfa781ebc" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.44:443 100.64.0.4:60978 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:06:40.578266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.578315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.585149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.585295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.585555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.590206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.590269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:40.590280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.609788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.609836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.617545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.617677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.617997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.618032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.620204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.620235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.620528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.621992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.622148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.622341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.622928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.643782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.643825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.650395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.650521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.650830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.650866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.651334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.651373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:40.671519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.671566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.678183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.678307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.678647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.678690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.679223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.679250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.701607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.701659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.705123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.705285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.708168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.708208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.714214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.714345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.714492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.717334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.717423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:40.717436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.719052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:40.719109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:06:40.719120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:06:40.577Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 13 - "100.64.0.3" "python-requests/2.32.5" "4d5e17b5-d51d-443d-9ab9-710dcb1e5eae" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.3:32144 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:06:40.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 13 - "100.64.0.2" "python-requests/2.32.5" "a7ee640a-38c6-4269-adaa-e46aace28fb8" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:43210 10.133.0.44:443 100.64.0.2:47248 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-21T19:06:40.643Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.3" "python-requests/2.32.5" "88597b66-14eb-4bb3-ac7a-a3288148dfd0" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:43210 10.133.0.44:443 100.64.0.3:40646 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-21T19:06:40.670Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.4" "python-requests/2.32.5" "250cccd6-ca95-42c8-a7d7-fa0c94168fe3" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:43206 10.133.0.44:443 100.64.0.4:5448 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-21T19:06:40.707Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.132.0.36" "Go-http-client/1.1" "ea8261c4-3a5d-4dd1-8a9f-c817956ffbe8" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:33182 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:06:40.699Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 19 - "100.64.0.2" "python-requests/2.32.5" "7b86d8b6-787f-472a-ab26-5d96cf391678" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.2:6972 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:06:49.562468Z info ads ADS: new connection for node:6 2026-05-21T19:06:49.564932Z info cache read certificate from file resource=file-root:system 2026-05-21T19:06:58.425390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.425442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.431800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.431939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.432161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.437232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.437295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:06:58.437305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:06:58.424Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 13 - "100.64.0.4" "python-requests/2.32.5" "4d903f26-3b08-4558-8d0f-a378ecbe9877" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:56082 10.133.0.44:443 100.64.0.4:58070 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:06:58.804523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:58.804577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:58.805592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:58.805629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:06:58.832794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.832839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.833783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.833813Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.854325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.854383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.861213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.861338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.861681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.861718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.865788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.865899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.866334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.867271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:06:58.867447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:06:58.867459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:06:58.803Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "3cae1111-d253-43b3-813a-fb155eb76c3c" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.44:443 100.64.0.2:3998 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-21T19:06:58.831Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "c040ce4e-1056-4c3d-bdfa-bb2b709467ac" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.44:443 100.64.0.3:25748 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-21T19:06:58.853Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 14 - "100.64.0.3" "python-requests/2.32.5" "d4f2d1be-db05-4724-8227-68b85b2abc50" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.44:443 100.64.0.3:33260 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.e2e-external-model.0 2026-05-21T19:07:36.586323Z info ads ADS: "" 6 terminated with stream closed 2026-05-21T19:07:40.602117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.602166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.608939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.609092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.609339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.622207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.622303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:07:40.622320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.666153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.666201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.671475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.671609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.674151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.674185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-21T19:07:40.600Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 320 21 - "100.64.0.4" "curl/7.76.1" "0e606591-80cc-46dc-b0a1-7148a2f4b411" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:56082 10.133.0.44:443 100.64.0.4:60762 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-21T19:07:40.680492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.680638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.680746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.682877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.682941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:07:40.682952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.684477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.684569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-21T19:07:40.684588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.732859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.732912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.740328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.740531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.740879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.740926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.743401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.743438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.743731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.747314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.747536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.747779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.748300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.783225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.783276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.790253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.790469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.790791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.790833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.791391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.791426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.791674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.793314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.793509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.793723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.794161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.825588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.825637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.832953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.833119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.833454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.833499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.834077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.834118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.834383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.835988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.836157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.836355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.836807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.867166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.867212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.874841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.875014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.875383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.875429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.876010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.876042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.876294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.877997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.878169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.878395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.878910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.903994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.904037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.910839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.910984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.911286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.911318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.911943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.911970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.938404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.938444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.946666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.946818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.947147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.947181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.947779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.947823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:40.973124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.973173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.980167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.980319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.980665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.980702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.981388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:40.981416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.010538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.010592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.017502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.017667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.017993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.018037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.018568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.018601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.046765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.046816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.054133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.054284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.054626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.054661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.055214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.055241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.079680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.079722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.086532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.086675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.086959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.086990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.087524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.087552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.113521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.113562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.119999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.120144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.120453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.120488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.120988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.121012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.147295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.147354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.148423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.148468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-21T19:07:41.174893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.174937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.180673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.180809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.185006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-05-21T19:07:41.185080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-05-21T19:07:41.185092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-05-21T19:07:40.673Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.132.0.36" "Go-http-client/1.1" "562d05ad-db37-4fb5-9d8a-95b60f74f00c" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 10.132.0.36:45182 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-21T19:07:40.665Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 19 - "100.64.0.4" "curl/7.76.1" "964bc916-bd08-4ed6-bb2e-626afb1fae48" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:58892 10.133.0.44:443 100.64.0.4:23418 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-21T19:07:40.732Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 423 16 - "100.64.0.2" "curl/7.76.1" "8beedb9d-a5da-4510-bacc-1a2e46ae070c" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54334 10.133.0.44:443 100.64.0.2:29696 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.782Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 377 11 - "100.64.0.2" "curl/7.76.1" "fe4c7891-9679-4ebc-96cd-8bb5a593d06a" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54334 10.133.0.44:443 100.64.0.2:1802 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.824Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 405 11 - "100.64.0.3" "curl/7.76.1" "7b696332-24dc-4e9e-a02a-86270f721dd1" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54334 10.133.0.44:443 100.64.0.3:59676 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.866Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 365 12 - "100.64.0.4" "curl/7.76.1" "0b099e36-b7bc-4ac5-ac43-45498de0b208" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54334 10.133.0.44:443 100.64.0.4:60772 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.903Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.2" "curl/7.76.1" "5a67a5b6-562c-4972-a278-7baf9b0be159" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54334 10.133.0.44:443 100.64.0.2:29702 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.937Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 10 - "100.64.0.3" "curl/7.76.1" "58f8cfee-1cc3-4867-86e4-4ad4883ba36b" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 100.64.0.3:59682 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:40.972Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 9 - "100.64.0.3" "curl/7.76.1" "afc0ce45-56be-4797-9fd2-b1f61c0b6a1a" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:45166 10.133.0.44:443 100.64.0.3:4474 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.009Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "07978a73-60b2-465c-8770-1e9e6b6b70f5" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54338 10.133.0.44:443 100.64.0.4:23422 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.046Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 9 - "100.64.0.2" "curl/7.76.1" "24937808-2739-4c31-9797-3fa2de6ccc3f" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 100.64.0.2:1808 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.078Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "a847dc14-de98-40c9-a229-a0f9381b03ec" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 100.64.0.3:4478 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.112Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "d8407a31-b7bb-4074-a401-f8b980f6f0a4" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.44:54346 10.133.0.44:443 100.64.0.4:60774 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.146Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 - - "-" 100 0 2 - "100.64.0.2" "curl/7.76.1" "23fc3508-da1b-47b4-a312-bceb449a454d" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.44:443 100.64.0.2:29716 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-21T19:07:41.173Z] "DELETE /v1/api-keys/f1db85e6-e372-44fd-891c-1373b905d2a7 HTTP/2" 200 - via_upstream - "-" 0 334 11 - "100.64.0.3" "curl/7.76.1" "e489e926-2a82-4887-868a-54dd7ac897d0" "maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com" "10.132.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.44:56082 10.133.0.44:443 100.64.0.3:59690 maas.apps.c9739b0f-c516-4c0a-969a-087be86f8f61.prod.konfluxeaas.com opendatahub.maas-api-route.1