2026-04-16T19:42:01.486076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:00.557Z] "GET /v1/models HTTP/1.1" 500 - - "-" 0 23 200 - "100.64.0.2" "Go-http-client/1.1" "474da750-102d-4c9f-8d68-77a5fdb1d0be" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:14676 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T19:42:00.876Z] "GET /v1/models HTTP/1.1" 500 - - "-" 0 23 201 - "100.64.0.3" "Go-http-client/1.1" "6e9a6224-32d2-41b7-81c2-260e0bc89333" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:53884 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T19:42:01.286Z] "GET /v1/models HTTP/1.1" 500 - - "-" 0 23 199 - "100.64.0.4" "Go-http-client/1.1" "8d304626-bd55-4d41-9caa-0abe443e540f" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:49240 10.133.0.30:443 100.64.0.4:24298 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 2026-04-16T19:42:01.924400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:01.924452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.123322Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:02.123361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.123404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.127405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:02.127473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:02.127505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:02.127514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:02.127520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:02.172605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.172653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.371629Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:02.371666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.371724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.454227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.454285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.653191Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:02.653223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.653255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:01.923Z] "GET /v1/models HTTP/1.1" 500 - - "-" 0 23 200 - "100.64.0.2" "Go-http-client/1.1" "3f6c223b-987f-4fe5-bb04-cbdfbdd8d788" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:49238 10.133.0.30:443 100.64.0.2:14682 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T19:42:00.516Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 1611 - "100.64.0.4" "python-requests/2.32.5" "248e1adf-dc01-4458-9380-69e23d3fde9b" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.4:24286 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:02.171Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 73 23 200 - "100.64.0.3" "python-requests/2.32.5" "f2251349-fdc3-44e9-88f0-8302db62db3a" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:53888 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:02.453Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "8bc6d46a-5bbd-484e-a931-3f1865839f0d" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37508 10.133.0.30:443 100.64.0.3:32718 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:02.726922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.726970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.738855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.738898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.776319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.776367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.803842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.804003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.804201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.807028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.807112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.807162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:02.807174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:02.807181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.867559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:02.867604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:03.066085Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:03.066122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:03.066151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:03.098118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.098167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.127216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.127435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.130650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.130749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:03.130799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:03.130809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:03.130818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:02.725Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 65 0 13 - "100.64.0.4" "python-requests/2.32.5" "f04e626d-2584-46e5-8cee-e874bca8d44b" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.4:64094 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:02.774Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 32 - "100.64.0.4" "python-requests/2.32.5" "12616c4c-e956-424e-9b66-9c984f029f24" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.4:24310 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:02.866Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "3fe9f67b-1df1-4799-b34b-dc1a454bcf9c" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:14686 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:03.096Z] "DELETE /v1/api-keys/92f319b2-218b-4203-832c-f6ffa2bab68a HTTP/1.1" 200 - via_upstream - "-" 0 294 34 - "100.64.0.3" "python-requests/2.32.5" "c4cb633d-a59e-4f6a-bc1b-93dc9137d7f6" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.3:53902 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T19:42:05.162058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.162109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.361088Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:05.361137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.361165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.395959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.396007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.595247Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:05.595282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.595313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.619432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.619479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.651350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.651530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.651777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.654344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.654405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.654448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:05.654457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:05.654463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.675924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.675972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.704079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:05.161Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "0026f3c5-a034-489f-9177-ca7434d4e9ac" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37520 10.133.0.30:443 100.64.0.2:22466 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:05.395Z] "POST /v1/chat/completions HTTP/1.1" 500 - - "-" 100 23 200 - "100.64.0.4" "python-requests/2.32.5" "facb07c0-4c83-476c-a846-36f69e6c5944" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.4:24322 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T19:42:05.618Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 36 - "100.64.0.3" "python-requests/2.32.5" "d595d186-45a6-4bc7-9883-e951b225fb11" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.3:32730 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T19:42:05.704248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.707055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.707114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.707150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:05.707158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:05.707164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.726605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.726656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.754460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.754621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.756237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.756301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.756334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:05.756342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:05.756348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.793360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.793411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.820828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.820998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.822177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.822236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.822269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:05.822276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:05.822283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.849435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.849484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.885749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.885907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.886108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.888220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.888275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.888309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:05.888317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:05.888324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.913326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.913375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.941713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.941870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.944725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.944794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.944832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:05.944840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:05.944846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:05.965224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.965279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.992842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.993027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.993261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.995439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.995509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:05.995560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:05.995571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:05.995582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:06.018529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:06.018587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:06.217616Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:06.217656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:06.217722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:05.674Z] "DELETE /v1/api-keys/8f8b3d63-91bd-492e-a777-fe0f58ed677d HTTP/1.1" 200 - via_upstream - "-" 0 291 32 - "100.64.0.4" "python-requests/2.32.5" "ac365214-710a-499f-aa06-ac2568988787" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.4:64104 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:05.725Z] "DELETE /v1/api-keys/8f8b3d63-91bd-492e-a777-fe0f58ed677d HTTP/1.1" 404 - via_upstream - "-" 0 29 31 - "100.64.0.2" "python-requests/2.32.5" "7abc2342-2de2-44b8-8fa5-bff903fffabd" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.2:22480 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:05.792Z] "DELETE /v1/api-keys/nonexistent-uuid-12345 HTTP/1.1" 404 - via_upstream - "-" 0 29 30 - "100.64.0.2" "python-requests/2.32.5" "9005f53d-48cb-4bfa-a0d4-4ba941f0e4a7" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.2:14690 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:05.848Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 40 - "100.64.0.3" "python-requests/2.32.5" "ad06eb87-aedf-4ff4-9530-2807e97430b7" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.3:53914 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:05.912Z] "DELETE /v1/api-keys/e91053a0-0222-490e-985f-4b86e74421cb HTTP/1.1" 200 - via_upstream - "-" 0 293 32 - "100.64.0.3" "python-requests/2.32.5" "e9b1bd52-ef2e-4698-8eee-f0b7fbb94e01" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.3:32738 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:05.963Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 31 - "100.64.0.4" "python-requests/2.32.5" "e0ce340e-3d4b-4b87-92e9-b1339f4a5b71" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.4:24332 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:06.017Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "e34182ae-2109-43d0-b9b7-cb9f789c8169" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37536 10.133.0.30:443 100.64.0.2:14702 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:06.739214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:06.739266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:06.938209Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:06.938243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:06.938271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:07.460740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:07.460787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:07.659649Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:07.659715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:07.659746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:06.738Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "dc889cb9-feb3-4f6d-89fb-cd8c3f9c7e1a" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:10970 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:07.459Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "34e9528d-6633-439e-9a67-dce9c31d0636" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37540 10.133.0.30:443 100.64.0.4:34148 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:08.182586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:08.182636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:08.381530Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:08.381563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:08.381592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:08.181Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "a929be61-b4d2-4382-b0a4-6fcbb531b689" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:55462 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:08.906634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:08.906708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:09.105517Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:09.105553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:09.105583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:09.628474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:09.628522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:08.905Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "dc12c271-c530-41a9-b7d3-34237cda39f5" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:10976 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:09.827452Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:09.827486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:09.827516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:10.350341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:10.350392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:10.549909Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:10.549941Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:10.549971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:09.627Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "4aff259c-280e-41fe-88da-fee854f577d5" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37562 10.133.0.30:443 100.64.0.4:34158 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:10.349Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 201 - "100.64.0.2" "python-requests/2.32.5" "cba29800-7a85-4110-8449-1e1487ab0d03" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:55470 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:11.074561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.074614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.273580Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:11.273617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.273645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:11.073Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "8be48159-d58b-43ba-bc3f-b29db64eb2ba" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37550 10.133.0.30:443 100.64.0.4:64110 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:11.796633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.796701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.995606Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:11.995642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:11.995700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:12.518725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:12.518772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:11.795Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "b9376e67-3f91-48b1-9e1b-81dbba5e0c53" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:10988 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:12.717727Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:12.717760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:12.717791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:13.239940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:13.239989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:13.437938Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:13.437971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:13.437999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:12.517Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "5e8a37f9-b047-4fe4-854d-f132a8a114fd" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:37568 10.133.0.30:443 100.64.0.4:34170 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:13.238Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.2" "python-requests/2.32.5" "37f74341-3116-46a6-8324-80e6597d6654" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:32964 10.133.0.30:443 100.64.0.2:55486 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:13.981728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:13.981774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:14.180465Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:14.180500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:14.180529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:14.704144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:14.704191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:13.980Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "b77aaa8c-6a81-43b3-bd92-8e31b2bba321" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:11000 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:14.903479Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:14.903510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:14.903540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:15.425859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:15.425908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:15.624793Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:15.624827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:15.624855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:14.703Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "90e875b0-a66c-496e-aede-88289936b8a1" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.4:34176 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:15.424Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "8ebb9b98-1369-45b9-8b9f-5d9b97c6d70c" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:32972 10.133.0.30:443 100.64.0.2:55492 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:16.156952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:16.157003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:16.355974Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:16.356010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:16.356039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:16.155Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "4abcc8fb-8afb-4bad-9a6d-c0e463742331" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:62974 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:16.879781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:16.879828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:17.079584Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:17.079620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:17.079648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:17.604178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:17.604227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:16.878Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 201 - "100.64.0.4" "python-requests/2.32.5" "d4076a17-3f25-4c52-b580-2e1ddcc18452" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:32998 10.133.0.30:443 100.64.0.4:21956 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:17.803219Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:17.803255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:17.803286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:18.326270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:18.326318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:18.525270Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:18.525301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:18.525331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:17.603Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "da618b02-1d0c-4a20-b738-0eef288085ef" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:32982 10.133.0.30:443 100.64.0.2:53466 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:18.325Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "6e847ea2-d430-47b4-b74d-844d8a0bc96f" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:6228 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:19.052911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.052958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.251871Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:19.251906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.251944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:19.051Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "af999fa5-c9df-47e8-a4ad-37a198cd3507" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:33004 10.133.0.30:443 100.64.0.3:11138 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:19.775018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.775064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.972964Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:19.972994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:19.973026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:20.500516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:20.500569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:20.699502Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:20.699533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:20.699560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:19.773Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.3" "python-requests/2.32.5" "dd05d47a-dfe0-487e-8072-6855994cea16" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:62988 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:20.499Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "0479810a-ccfb-4868-970a-21bc218ae660" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.4:55160 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:21.224502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:21.224557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:21.423541Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:21.423578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:21.423608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:21.223Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "79b0aca7-db6b-4303-b6f6-5bb79602ba7a" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:33012 10.133.0.30:443 100.64.0.2:6240 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:21.949210Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:21.949261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:22.148636Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:22.148692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:22.148723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:22.679651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:22.679721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:21.948Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "d539d3dc-ad81-49b5-8fa9-70dbe2a996e7" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:11150 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:22.878705Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:22.878737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:22.878768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:23.400655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:23.400741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:23.599738Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:23.599771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:23.599801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:22.678Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "62bd6746-77ef-4abd-a6b8-4f1474eac769" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40668 10.133.0.30:443 100.64.0.4:39946 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:23.399Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "b180db28-0812-48e7-a843-9eafc4d0905e" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:33010 10.133.0.30:443 100.64.0.4:21962 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:24.123487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:24.123531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:24.322458Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:24.322490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:24.322521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:24.122Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "8555dbea-8548-4930-a30b-c2f3ad5c1765" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:45396 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:24.847446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:24.847492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:25.046349Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:25.046385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:25.046413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:25.568874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:25.568916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:24.784Z] "POST /bin/sh HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.3" "libredtail-http" "d462a054-a652-4555-b060-6f6f30f364f6" "52.0.86.33:80" "-" - - 10.133.0.30:80 100.64.0.3:42548 - - [2026-04-16T19:42:24.846Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "64e35628-5679-4c25-b2ed-55778c5f3bc4" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:49366 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:25.780069Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:25.780107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:25.780144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:26.302472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:26.302521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:26.501200Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:26.501230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:26.501261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:25.567Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 212 - "100.64.0.2" "python-requests/2.32.5" "fffebaed-50c8-4a5f-a293-c17c10ef33a8" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40676 10.133.0.30:443 100.64.0.2:53476 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:26.301Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "493d0cc7-6663-485c-851f-f62bc361a0bc" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:54038 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:27.025762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.025807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.224705Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:27.224738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.224766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:27.024Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.4" "python-requests/2.32.5" "405009a9-5da2-4cc1-aece-111f1a28189b" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40680 10.133.0.30:443 100.64.0.4:9320 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:27.749070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.749116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.948002Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:27.948033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:27.948060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:28.470650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:28.470715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:28.669760Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:28.669792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:28.669820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:27.748Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "3e307a4e-68f0-4b71-bada-c78f1ed2d8e5" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:1748 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:28.469Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "27029e9e-3cc2-4f67-823f-323c823c5b24" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40684 10.133.0.30:443 100.64.0.3:54050 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:29.192975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:29.193024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:29.392902Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:29.392937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:29.392967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:29.191Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 201 - "100.64.0.4" "python-requests/2.32.5" "02730d8a-39fb-4e0e-8d87-46144166bb96" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40688 10.133.0.30:443 100.64.0.4:9326 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:29.915824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:29.915870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:30.115155Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:30.115187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:30.115215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:30.639734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:30.639780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:29.914Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "2a353ade-ff8f-4eb2-a621-98ae20d45f1b" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:1750 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:30.838867Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:30.838901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:30.838930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:31.362638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:31.362716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:31.561306Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:31.561340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:31.561370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:30.638Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "fd697400-511b-4e16-943d-17aabb781b77" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:54058 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:31.361Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.4" "python-requests/2.32.5" "12d7fbf6-6b5b-4f6a-ae73-6edf410ea929" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40718 10.133.0.30:443 100.64.0.4:39956 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:32.088663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:32.088734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:32.286081Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:32.286117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:32.286145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:32.087Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 198 - "100.64.0.4" "python-requests/2.32.5" "e6578851-a1b3-4914-af9b-aa7624c904a4" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40704 10.133.0.30:443 100.64.0.4:9338 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:32.808490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:32.808540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:33.007620Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:33.007653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:33.007703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:33.532380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:33.532425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-16T19:42:32.807Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.2" "python-requests/2.32.5" "a1a2d6e4-5e5b-4fe1-bf5d-d5ac279580c9" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:1760 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:33.731441Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:33.731475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:33.731503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:34.259105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:34.259159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:34.457186Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:34.457222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:34.457252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:33.531Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "5040a4e5-3ea6-4e36-b9ac-e4554474ab63" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54836 10.133.0.30:443 100.64.0.3:54070 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:34.258Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.2" "python-requests/2.32.5" "5dcf0b7d-f2f2-402f-8dcb-52336cab8469" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.2:43132 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:34.985581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:34.985633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:35.183136Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=17 2026-04-16T19:42:35.183174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:35.183204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:35.709321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:35.709371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:34.984Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.3" "python-requests/2.32.5" "c3ec2d02-4215-4bbf-83af-14496cf06268" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:20818 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-04-16T19:42:35.907266Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:35.907302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:35.907331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.447592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.447643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.479304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.479482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.479791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.482440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.482497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.482536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:36.482544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:36.482550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.506767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.506814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.538980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.539138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.539332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.541622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.541707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.541746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:36.541754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:36.541761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.564178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.564225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.592125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.592290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.592485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.594821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.594876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.594911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:36.594919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:36.594925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.615890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.615937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.648350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.648510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.651641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.651728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.651767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:36.651775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:36.651782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.673061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.673109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.701216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.701369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.704402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.704462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.704500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:36.704507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:36.704514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:35.708Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 199 - "100.64.0.4" "python-requests/2.32.5" "1e7837cb-6123-4536-b859-9294a8a131d6" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54850 10.133.0.30:443 100.64.0.4:9352 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T19:42:36.446Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 36 - "100.64.0.2" "python-requests/2.32.5" "1a11eaff-8784-490b-b7fd-0c9884928131" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.2:19852 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.505Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 36 - "100.64.0.3" "python-requests/2.32.5" "bb85882a-dc22-4652-a1e3-26c3030851cd" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.3:32574 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.562Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 32 - "100.64.0.4" "python-requests/2.32.5" "697d62b3-c807-496f-b285-edeaf9eb7e2b" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.4:42386 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.614Z] "DELETE /v1/api-keys/d5134fca-f6a7-47d6-814f-2de8cd637158 HTTP/1.1" 200 - via_upstream - "-" 0 288 37 - "100.64.0.2" "python-requests/2.32.5" "11dc6487-9a70-4fa4-9308-1f69c7265db6" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.2:19864 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.671Z] "DELETE /v1/api-keys/c0421328-d7ca-49c3-8c74-919f88c7dbfe HTTP/1.1" 200 - via_upstream - "-" 0 288 32 - "100.64.0.3" "python-requests/2.32.5" "85aea21f-4ee1-428e-b505-800ed73ff2c7" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.3:32580 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T19:42:36.724938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.724987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.752589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.752774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.755893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.755954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.755991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T19:42:36.755999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=18 2026-04-16T19:42:36.756005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.778762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.778820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.806086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.806260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.806481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.808607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.808701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.808749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:36.808760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:36.808770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.831301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.831362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.858892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.859071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.859283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.861558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.861627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.861696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:36.861707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:36.861717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.884494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.884554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.912059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.912215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.912413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.914718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.914789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.914839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-16T19:42:36.914850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /model thread=17 2026-04-16T19:42:36.914859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-16T19:42:36.936743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:36.936789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:37.135553Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1143 wasm log openshift-ingress.kuadrant-maas-default-gateway: gRPC status code is not OK thread=18 2026-04-16T19:42:37.135590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T19:42:37.135617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T19:42:36.723Z] "DELETE /v1/api-keys/f63c8e7d-9b94-47ee-a74c-af4ecbf6b8b2 HTTP/1.1" 200 - via_upstream - "-" 0 288 32 - "100.64.0.4" "python-requests/2.32.5" "cbc9282c-4151-4532-8396-5473c3136dde" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34982 10.133.0.30:443 100.64.0.4:42396 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.777Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 31 - "100.64.0.2" "python-requests/2.32.5" "c04e089b-8ffd-4065-ab03-9260a60b0997" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.2:19866 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.830Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 31 - "100.64.0.4" "python-requests/2.32.5" "ffabaf94-9677-4e05-a093-7f38058eaa0d" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.4:34358 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.883Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 31 - "100.64.0.2" "python-requests/2.32.5" "a3c8f6b1-92f4-4986-b07b-362a6d689a0a" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.134.0.24:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.30:34970 10.133.0.30:443 100.64.0.2:43148 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T19:42:36.935Z] "POST /v1/completions HTTP/1.1" 500 - - "-" 65 23 200 - "100.64.0.3" "python-requests/2.32.5" "74891a41-7d87-4965-9709-b9c5e9d8a35c" "maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 100.64.0.3:20822 maas.apps.b6eed26b-8fd3-48dc-8fce-4c8c0972e457.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0