2026-05-20T17:37:24.515231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:24.515441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:24.518796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:24.518855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:24.518894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:37:24.508Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 317 10 - "100.64.0.2" "python-requests/2.32.5" "51b77993-86d8-4530-b2c9-6aa1722eaff8" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.2:19712 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:37:32.551644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.551706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.555954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.556086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.558264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.558298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.564701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.564848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.564984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.566711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.566768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:32.566778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.567985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:32.568036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:32.568047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.274883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.274934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.286579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.286731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.286993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.290925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:33.290990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:33.291001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:37:32.557Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.43" "Go-http-client/1.1" "61460d19-b8c5-459a-ae50-c07927ade7b4" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 10.133.0.43:52212 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-20T17:37:32.550Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 17 - "100.64.0.3" "python-requests/2.32.5" "c2204d85-eafb-488e-af2b-ef777aec84f9" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:5066 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:37:33.273Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 17 - "100.64.0.2" "python-requests/2.32.5" "23c4c293-5bd6-428b-9441-c8e3c32f7619" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.2:53084 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:37:41.323204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.323255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.327311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.327454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.329697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.329734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.329746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.336630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.336760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.336910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.336995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.338887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.338914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.338964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:41.338974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.338987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:41.338994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.340040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:41.340097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:41.340109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:37:41.328Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.133.0.43" "Go-http-client/1.1" "3cb50a89-cbe6-4f2c-9f71-efb54d45d67b" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 10.133.0.43:52212 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-20T17:37:41.322Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 18 - "100.64.0.4" "python-requests/2.32.5" "9f56d06a-0b22-4299-adba-30fb52f19455" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.4:56918 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:37:50.513371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.513422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.519073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.519204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.519415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.523362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:37:50.523425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:37:50.523436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:37:50.512Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 327 11 - "100.64.0.3" "python-requests/2.32.5" "4dfbca62-02c7-4cf7-ac57-48e3ad522c6b" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:40580 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:38:06.799645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:06.799693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:06.804369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:06.804502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:06.806439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:06.806499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:38:06.806510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:38:06.798Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.3" "python-requests/2.32.5" "a363daa9-ecba-44d7-a489-b5ea1c0a3bde" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.3:42508 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:38:23.907099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:23.907148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:23.912856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:23.913005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:23.915032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:23.915105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:38:23.915122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:38:23.905Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.4" "python-requests/2.32.5" "ef687d0f-a285-4846-a56e-6402571dea8c" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.4:64466 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:38:41.088245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:41.088294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:41.094685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:41.094824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:41.097057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:38:41.097117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:38:41.097128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:38:41.087Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 10 - "100.64.0.2" "python-requests/2.32.5" "8b224557-0ad6-4cc4-b59c-46b248dda1e3" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.2:60108 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:38:58.499039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:58.499089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:58.504731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:58.504891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:58.507015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:38:58.507077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:38:58.507088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:38:58.497Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 9 - "100.64.0.4" "python-requests/2.32.5" "f3860758-377c-4d9b-85e5-7640d1a5c37b" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.4:56922 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:39:12.589537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.589588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.595071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.595202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.595422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.599404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:12.599468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:12.599480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:39:12.588Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 11 - "100.64.0.2" "python-requests/2.32.5" "2041fe10-4ab1-4e8b-90a4-22aeedd8ec30" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.2:10844 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:39:20.633983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.634034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.649449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.649615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.659576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.659617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.666261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.666400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.666527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.668237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.668299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:20.668310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.669408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:20.669461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:20.669473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:39:20.658Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "10.133.0.43" "Go-http-client/1.1" "486ff289-b85b-4ac0-bee3-f5e39efdd6da" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:35160 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-20T17:39:20.632Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 471 36 - "100.64.0.3" "python-requests/2.32.5" "cf403b9b-db2c-43f2-bd1c-971ccadb471d" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.3:49714 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:39:32.725208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.725257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.731200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.731350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.731587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.735523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.735590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:32.735602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:32.761968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.762013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.766917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.767047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.767253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.770708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:32.770771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:39:32.770782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:39:32.723Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 11 - "100.64.0.2" "python-requests/2.32.5" "c30a1429-a9d3-4059-b57e-31bac0253d02" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.2:64856 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:39:32.760Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 9 - "100.64.0.3" "python-requests/2.32.5" "dd2b4347-1ee7-9fde-9379-df71d6f86196" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:52420 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:39:40.803251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.803303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.807384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.807520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.809963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.809998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.817814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.817966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.818085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.819913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.819977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:40.819988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.821104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.821157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:40.821168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.853263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:40.853308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:40.856718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:40.856844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:40.859045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.859083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.865506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.865637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.865760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.870232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.870299Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:40.870311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:40.872496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:39:40.872590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:39:40.872610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:39:40.809Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "10.133.0.43" "Go-http-client/1.1" "751d0b70-95ea-418f-a7da-0863f58174c4" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:35160 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-20T17:39:40.802Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 468 19 - "100.64.0.4" "python-requests/2.32.5" "5efb65a8-effc-44ba-8eb3-9f16d4423a84" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.4:52224 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:39:40.858Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "10.133.0.43" "Go-http-client/1.1" "3df369f5-0fcd-4f2e-b138-831ad52aac91" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:45524 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-20T17:39:40.852Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 20 - "100.64.0.2" "python-requests/2.32.5" "1afa5df4-c68d-4aa2-a567-2b58881a69ff" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.2:8912 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:39:57.416363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.416417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.421656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.421792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.424223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.424260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.433112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.433252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.434969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.435030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:57.435041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.436470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.436504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.445161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.445288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.446987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.447057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:57.447074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.448484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.448523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.457946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.458067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.462606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.462664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:57.462675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.463908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:39:57.463967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:39:57.463979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:39:57.423Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.43" "Go-http-client/1.1" "56c69188-3db9-4206-89b9-263ad9be5e41" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:35160 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-20T17:39:57.435Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.133.0.43" "Go-http-client/1.1" "91ab8644-0735-4e6d-9e87-1107b5fa8578" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:45524 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-20T17:39:57.447Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 14 - "10.133.0.43" "Go-http-client/1.1" "44623a0d-fcd0-4bf4-a220-b24e59f09f7e" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:58916 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-20T17:39:57.415Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1361 48 - "100.64.0.4" "python-requests/2.32.5" "7c036531-88de-4116-8258-ea955342f64f" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.4:45422 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:40:13.960893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:13.960943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:13.966306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:13.966436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:13.968918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.968952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.977895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.978031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.979778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.979839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:13.979849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:13.981099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:13.981162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:40:13.981174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.006394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.006440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.011891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.012025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.014323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.014360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.022794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.022959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.024560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.024618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:14.024630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:14.025785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:14.025843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:40:14.025854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:40:13.968Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.43" "Go-http-client/1.1" "32238979-409c-4e43-8ae7-b9e9020a23f4" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:35160 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-05-20T17:40:13.959Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 470 21 - "100.64.0.3" "python-requests/2.32.5" "8495eb89-fed6-4b95-ab42-adc3bbc43383" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:3340 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:40:14.013Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.133.0.43" "Go-http-client/1.1" "3ab8a56e-095b-4dd6-b1f1-852001a41be9" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.44:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:45524 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-05-20T17:40:14.005Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 20 - "100.64.0.3" "python-requests/2.32.5" "1bd9f174-4b75-45f2-8cdd-ddac0afc304d" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:21934 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:40:23.059211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:23.059262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:23.060468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:23.060503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:40:23.058Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "45a3ef31-f13b-462f-be3d-25382f71d85a" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.27:443 100.64.0.4:17354 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:40:39.697730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.697785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.707604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.707756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.708039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.715287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.715379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:39.715397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.739967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.740020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.747959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.748111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.748425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.748470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.749991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.750026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.750275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.751948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.752106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.752308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.752891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.776154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.776205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.783209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.783333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.783620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.783654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.784218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.784246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:40:39.696Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 18 - "100.64.0.2" "python-requests/2.32.5" "caa692e4-56ae-49fd-8c4e-d8354b3f3b10" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.2:3828 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:40:39.739Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 13 - "100.64.0.4" "python-requests/2.32.5" "c5ab6923-bf73-45f6-ae2d-a269bdfaaeca" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:36042 10.134.0.27:443 100.64.0.4:46882 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-20T17:40:39.775Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 8 - "100.64.0.2" "python-requests/2.32.5" "d4df005f-4c64-434c-bb6b-fb7d35da686c" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:36042 10.134.0.27:443 100.64.0.2:46176 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-05-20T17:40:39.808230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.808275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.815510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.815642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.815962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.815994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.816507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.816533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.837943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:39.837992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:39.841318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:39.841449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:39.844026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.844058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.850742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.850858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.850975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.852386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.852445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:39.852457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:39.854002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:39.854071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:40:39.854088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:40:39.807Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 9 - "100.64.0.3" "python-requests/2.32.5" "43a1cbd6-e0f5-4f10-b919-a3c0b1c15e43" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.27:443 100.64.0.3:23080 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-05-20T17:40:39.843Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "10.133.0.43" "Go-http-client/1.1" "6d096341-c7e5-442e-b063-448e83196796" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.134.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:48912 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-05-20T17:40:39.836Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 17 - "100.64.0.4" "python-requests/2.32.5" "5f65e34f-3d22-4b19-afc4-d445aa5c2dea" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.4:8728 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-05-20T17:40:48.718762Z info ads ADS: new connection for node:6 2026-05-20T17:40:48.721341Z info cache read certificate from file resource=file-root:system 2026-05-20T17:40:55.478841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.478909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.484799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.484955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.485178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.489044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.489104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:55.489116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.851326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.851378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.852388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.852424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.876266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.876310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.877277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:40:55.877308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:40:55.477Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 11 - "100.64.0.2" "python-requests/2.32.5" "26e019ed-fb20-462d-8094-4e0546248f9a" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.2:47670 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:40:55.850Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "56904b0d-05f5-4cff-987b-2c592cef0eb0" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.27:443 100.64.0.3:49128 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-20T17:40:55.875Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "39d03cf9-70f3-483e-8883-8a15f2fb26d1" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.27:443 100.64.0.4:1832 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-external-model.0 2026-05-20T17:40:55.903584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.903635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.911297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.911449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.911798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.911844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.913385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.913428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.913691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.914740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:40:55.914911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:40:55.914928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-05-20T17:40:55.902Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - - "-" 83 98 12 - "100.64.0.2" "python-requests/2.32.5" "4a1c946a-dd32-4813-8e27-114c9f72bb03" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.27:443 100.64.0.2:47680 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-05-20T17:41:08.966Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.134.0.27:443 100.64.0.3:1108 - - [2026-05-20T17:41:09.026Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.134.0.27:443 100.64.0.2:13808 - - 2026-05-20T17:41:33.609220Z info ads ADS: "" 6 terminated with stream closed 2026-05-20T17:41:35.816394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.816447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.822755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.822918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.823154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.836131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.836213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:41:35.836226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.880457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.880505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.885354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.885511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.887783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.887823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.894805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.894979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.895100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.896973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.897034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-05-20T17:41:35.897045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:35.898227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.898321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:41:35.898340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.952054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.952106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.959447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.959622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.959976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.960022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.961515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.961560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.961816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.963803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.964017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.964227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:35.964730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:41:35.815Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 320 21 - "100.64.0.3" "curl/7.76.1" "cdabab61-9998-4569-b5fe-aeda5e0eba36" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:49200 10.134.0.27:443 100.64.0.3:20232 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:41:35.886Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "10.133.0.43" "Go-http-client/1.1" "59e82bc2-a07b-404f-9da8-2f30eca37fe6" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:58916 10.134.0.27:443 10.133.0.43:33328 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-05-20T17:41:35.879Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 19 - "100.64.0.4" "curl/7.76.1" "664ed69a-53af-4477-a2c3-577588a0deaf" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.4:20748 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-05-20T17:41:35.951Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 337 13 - "100.64.0.2" "curl/7.76.1" "4daf1e4f-ffb8-40db-9e91-f03cd39602e7" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 100.64.0.2:34756 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 2026-05-20T17:41:36.005271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.005318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.013045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.013199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.013537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.013572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.014233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.014263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.014513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.016630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.016793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.017010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.017427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.042963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.043003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.050210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.050357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.050672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.050711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.051275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.051304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.051556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.053386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.053545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.053729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.054175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.083242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.083286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.090388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.090541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.090896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.090931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.091428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.091452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.091689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.093379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.093540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.093724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.094146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.120901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.120949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.128151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.128304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.128620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.128656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.129196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.129223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.129485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.131270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.131424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.131606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.132064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.161629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.161672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.168474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.168616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.168923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.168955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.169483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.169507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.196650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.196691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.203611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.203757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.204078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.204112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.204607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.204634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.233927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.233969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.241281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.241424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.241706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.241738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.242272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.242297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.267945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.267985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.274787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.274967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.275257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.275289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.275821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.275846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.307032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.307075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.314051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.314197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.314499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.314532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.315116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.315146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-05-20T17:41:36.342171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.342214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.349432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.349580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.349912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.349944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.350481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.350509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.381339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.381381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.382406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.382439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.410082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.410128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.415424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.415555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.420314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-05-20T17:41:36.420388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-05-20T17:41:36.420399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-05-20T17:41:36.004Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 354 12 - "100.64.0.3" "curl/7.76.1" "2b7a68b1-0678-4bdc-af38-5d5e3f2ad506" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:58916 10.134.0.27:443 100.64.0.3:20236 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.042Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 385 11 - "100.64.0.4" "curl/7.76.1" "175f78f7-f3c2-4e33-9f50-3e459a8bc116" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 100.64.0.4:20756 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.082Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 347 11 - "100.64.0.2" "curl/7.76.1" "c871bbe7-0a75-4f05-bd70-1fc45ca94c60" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 100.64.0.2:34758 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.120Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 459 11 - "100.64.0.3" "curl/7.76.1" "1550a02b-336f-475c-8d78-b0d9e2fc1e69" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 100.64.0.3:20244 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.160Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "7567dac9-e222-4de1-97c7-a3b8ed151c0e" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:51716 10.134.0.27:443 100.64.0.4:20762 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.196Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.2" "curl/7.76.1" "5e588e5b-4b9c-42bc-8905-c96c65315b2c" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:58916 10.134.0.27:443 100.64.0.2:34768 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.233Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 9 - "100.64.0.3" "curl/7.76.1" "f8571627-d3e8-4e6e-ac51-f05aa7f51630" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.27:443 100.64.0.3:20260 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.267Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "50e63281-8e96-4b9e-b265-93fba8e93941" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.27:443 100.64.0.4:20776 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.306Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "eaabd1f7-515f-4286-b675-86ecaa2aa10b" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:44744 10.134.0.27:443 100.64.0.4:63442 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.341Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 9 - "100.64.0.3" "curl/7.76.1" "2dd9f8c1-0d86-47f1-8e30-765824d6d1f9" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.27:44748 10.134.0.27:443 100.64.0.3:60982 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.380Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 - - "-" 100 0 1 - "100.64.0.2" "curl/7.76.1" "cf7ebfde-bd26-4c54-93d1-3d7f0ced16d6" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.27:443 100.64.0.2:34772 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-05-20T17:41:36.409Z] "DELETE /v1/api-keys/705d3e54-1c76-458b-a782-bcf6c548ac99 HTTP/2" 200 - via_upstream - "-" 0 334 11 - "100.64.0.3" "curl/7.76.1" "43398b15-f1e3-486c-b93d-3a7593d575b8" "maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com" "10.133.0.43:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.27:57680 10.134.0.27:443 100.64.0.3:20270 maas.apps.f8191e97-c644-4657-9822-de7e3203ee43.prod.konfluxeaas.com opendatahub.maas-api-route.1