2026-07-06T15:48:40.616014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:48:40.602Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.41" "Go-http-client/1.1" "892a43a6-35e1-46a0-8643-0e081fad0614" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:42894 10.133.0.37:443 10.133.0.41:50046 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:48:40.594Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 481 21 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "e4c21e8f-5729-4bc8-8690-ee19cb355542" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:39000 10.133.0.37:443 10.134.0.9:59934 - opendatahub.maas-api-route.1 2026-07-06T15:50:56.687180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.687228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.702303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.702426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.702669Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.717580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:50:56.717643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:50:56.717654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:50:56.685Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 92 335 32 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b5751c68-961a-42bf-8a7e-9741f14270a8" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:56026 - opendatahub.maas-api-route.1 2026-07-06T15:51:00.746208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.746255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.766259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.766387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.776380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.776421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.776611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.776646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.786379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.786501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.786644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.789656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.789715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:00.789726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.793923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.794041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.794145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.807758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.807825Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:00.807839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:00.809806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:00.809894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:00.809915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:00.774Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 15 - "10.133.0.41" "Go-http-client/1.1" "4e7fe33a-2e39-489d-94f5-15ab023f941b" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40438 10.133.0.37:443 10.133.0.41:36980 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:51:00.774Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 33 - "10.133.0.41" "Go-http-client/1.1" "ad00ba62-3aaa-414d-b225-95be3c17fac4" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.47:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:39696 10.133.0.37:443 10.133.0.41:36984 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-06T15:51:00.744Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 827 65 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "219c6bc0-d9f8-4ee3-8115-04ee18c0e1fa" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:56036 - opendatahub.maas-api-route.1 2026-07-06T15:51:11.129194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.129246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.140716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.140843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.144364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.144406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.144593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.144629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.149327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.149362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.160710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.160796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.160829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.160923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.160928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.161021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.162110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.162166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:11.162177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.162547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.162602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:11.162613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:11.163280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.163388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.163473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.166346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.166393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:11.166404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.168011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:11.168080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:11.168099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:11.142Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 20 - "10.133.0.41" "Go-http-client/1.1" "63743e74-a2db-40eb-8eb5-d2e9f504a8f6" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40438 10.133.0.37:443 10.133.0.41:36980 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:51:11.142Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 20 - "10.133.0.41" "Go-http-client/1.1" "6baac3f8-7529-4c3f-b4a4-f44b5d98927a" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:42894 10.133.0.37:443 10.133.0.41:36984 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:51:11.147Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 18 - "10.133.0.41" "Go-http-client/1.1" "fc6871ad-23da-423d-9eae-b3b7a3d7e306" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.47:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:53946 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-06T15:51:11.127Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1372 40 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b2f4356b-a019-44b3-96c2-d60706e58de8" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:54822 - opendatahub.maas-api-route.1 2026-07-06T15:51:20.666950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:20.667009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:20.677729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:20.677862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:20.682624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.682660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.682672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.699705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.699829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.699922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.699989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.701480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.701507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.701583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:20.701597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.701619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:20.701630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:20.702541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:20.702606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:20.702621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:51:20.680Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 20 - "10.133.0.41" "Go-http-client/1.1" "923f6b4c-db93-4f82-962e-107ca19abc9a" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:59496 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:51:20.665Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 484 37 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9118c0c3-26b9-4f7f-b1b4-39b51e39559c" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:58738 - opendatahub.maas-api-route.1 2026-07-06T15:51:32.153167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.153225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.163308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.163459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.163721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.168097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:32.168159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:32.168171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:51:32.151Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "ee04bf9e-988b-4ab4-ba39-a255ebd74df9" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:51288 - opendatahub.maas-api-route.1 2026-07-06T15:51:36.200002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.200050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.206216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.206334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.207913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.207971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:36.207981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:51:36.198Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 9 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "d4a9cc4d-248e-4565-ad02-47981786f80a" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:51290 - opendatahub.maas-api-route.1 2026-07-06T15:51:36.782416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.782467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.793984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.794134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.794367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.797677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:36.797748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:36.797760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:51:36.780Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 316 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "37c83011-734c-4cda-b350-217a45e455f1" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:45486 - opendatahub.maas-api-route.1 2026-07-06T15:51:40.830464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:40.830523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:40.836555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:40.836673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:40.839637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.839680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.849281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.849472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.849637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.851054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.851123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:40.851137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:40.852106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:40.852165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:40.852177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:41.225370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.225425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.235005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.235181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.235424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.238178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:41.238238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:41.238250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:40.837Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 13 - "10.133.0.41" "Go-http-client/1.1" "c72766fa-4e19-4ef8-b28d-afa9ed7eb58a" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:59496 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:51:40.829Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 597 23 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f96e01f3-a0ff-4045-b705-68c8575bfef0" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:45500 - opendatahub.maas-api-route.1 [2026-07-06T15:51:41.223Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 317 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "dc4868b7-ef48-46f2-bf75-b99707e2d475" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:45516 - opendatahub.maas-api-route.1 2026-07-06T15:51:45.274079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.274126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.280499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.280635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.283574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.283604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.292704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.292835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.292923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.294326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.294380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:45.294390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.295294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:45.295345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:45.295356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:45.281Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.41" "Go-http-client/1.1" "ffdde115-c5ff-47cb-a829-a32a599c29d4" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:59496 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:51:45.272Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 597 22 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9778921e-6fcb-4915-8c50-ba4d667d8343" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:45524 - opendatahub.maas-api-route.1 2026-07-06T15:51:46.043194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.043252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.051827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.051957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.052179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.055425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:51:46.055495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:51:46.055511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:51:46.041Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "17e63613-6a58-409d-8d76-22571e7a0830" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:45536 - opendatahub.maas-api-route.1 2026-07-06T15:51:50.086686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.086732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.092767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.092884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.095771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.095806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.104688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.104802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.104888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.106258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.106318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:50.106329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.107212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:50.107264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:50.107275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:50.093Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "10.133.0.41" "Go-http-client/1.1" "b27aa2f9-7f45-45c2-8542-61ad9c5288b0" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:59496 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:51:50.085Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 481 22 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "3445fbb0-463e-4dbf-bacd-5fc4cf017f94" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:55904 - opendatahub.maas-api-route.1 2026-07-06T15:51:55.323677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.323734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.335910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.336050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.336274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.339441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:51:55.339500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:51:55.339512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:51:55.322Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "140545fd-59c9-48ef-8b7a-4950d8d5157c" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:55914 - opendatahub.maas-api-route.1 2026-07-06T15:52:03.630784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:03.630831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:03.662637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:03.662719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:03.664086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:03.664153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:52:03.664167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:52:03.629Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 34 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "2454a5d8-99f4-4bdd-b725-d455f672b878" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:47752 - opendatahub.maas-api-route.1 2026-07-06T15:52:08.696560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:08.696608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:08.702671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:08.702791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:08.704202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:08.704258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:52:08.704268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:52:08.695Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 9 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "2909b16d-cedf-43e0-b1c7-eecaa1c696d4" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:52604 - opendatahub.maas-api-route.1 2026-07-06T15:52:17.795024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:17.795075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:17.806493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:17.806670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:17.808379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:17.808439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:52:17.808453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:52:17.793Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "073833fc-4e0b-4d79-a506-e167a2278bc5" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:36974 - opendatahub.maas-api-route.1 2026-07-06T15:52:27.045738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:27.045787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:27.057646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:27.057778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:27.059683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:27.059762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:52:27.059780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:52:27.044Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 15 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "2cffec88-090b-4bbf-8126-c37866d5255b" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:40406 - opendatahub.maas-api-route.1 2026-07-06T15:52:36.644335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:36.644394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:36.656034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:36.656170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:36.657776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:36.657840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:52:36.657856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:52:36.642Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9a1edbca-72e8-4a19-9fb5-8a102c93670d" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:50394 - opendatahub.maas-api-route.1 2026-07-06T15:52:50.181097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.181155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.192812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.192947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.193170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.196305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:50.196373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:52:50.196389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:52:50.179Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "c93cdd34-e3be-49c2-af91-ba744b9080b5" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:48624 - opendatahub.maas-api-route.1 2026-07-06T15:52:54.229788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:54.229843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:54.237807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:54.237942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:54.241096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.241135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.249092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.249226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.249326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.250441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.250497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:52:54.250508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:52:54.251444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:52:54.251499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:52:54.251511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:52:54.239Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "10.133.0.41" "Go-http-client/1.1" "725e2887-078a-4cde-a7dd-9c362a76bed5" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40438 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:52:54.228Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 478 23 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "3bbd8a8d-91f8-481d-976b-ffe0015882f7" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:48632 - opendatahub.maas-api-route.1 2026-07-06T15:53:04.712804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.712860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.724577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.724709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.724936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.728455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.728523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:04.728554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.757766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.757804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.766667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.766787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.766969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.769578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:04.769629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:04.769640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:53:04.710Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "638c6330-28bc-4b3d-84c4-ed12e69f5bae" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:52942 - opendatahub.maas-api-route.1 [2026-07-06T15:53:04.756Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 13 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "39ec1d33-7c61-4dd0-b117-1e25be9c3a6d" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:52950 - opendatahub.maas-api-route.1 2026-07-06T15:53:08.800920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.800969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.808393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.808580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.813310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.813346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.821682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.821796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.821903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.823077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.823135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:08.823146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.824319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.824371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:08.824382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.849154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:08.849196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:08.854541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:08.854662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:08.857445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.857479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.865881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.865992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.866079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.867383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.867430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:08.867440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:08.868246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:08.868302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:08.868314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:53:08.810Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 12 - "10.133.0.41" "Go-http-client/1.1" "b6ae1f4e-a694-4374-bd6b-cd8d0f35c2e1" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40438 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:53:08.799Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 475 24 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "ce5e3288-d24a-4f79-a160-2cc5bb41c838" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:51764 - opendatahub.maas-api-route.1 [2026-07-06T15:53:08.855Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 11 - "10.133.0.41" "Go-http-client/1.1" "5cfe6bf6-c091-49fe-ac71-83ca3001db24" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.47:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:53946 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-06T15:53:08.847Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 352 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b3a0a354-3d4f-40dd-b4e9-9a08f057f789" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:51772 - opendatahub.maas-api-route.1 2026-07-06T15:53:21.742282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.742330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.754345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.754465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.759178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.759213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.768700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.768749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.770300Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.770337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.775227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.775359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.775457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.776931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.776990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:21.777002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.785059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.785194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.785296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.785652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.785781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.785889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.787107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.787165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:21.787177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.787439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.787482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:21.787492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:21.788695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:21.788749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:21.788761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:53:21.757Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 19 - "10.133.0.41" "Go-http-client/1.1" "8e4ae704-84a4-47af-96e3-b0ffd047818e" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:59496 10.133.0.37:443 10.133.0.41:47016 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:53:21.766Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 20 - "10.133.0.41" "Go-http-client/1.1" "5a51344d-d09f-41ae-9576-48d3f0800607" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.47:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:39696 10.133.0.37:443 10.133.0.41:59632 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-06T15:53:21.766Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 20 - "10.133.0.41" "Go-http-client/1.1" "8843edc8-6a6d-4ac7-a491-27953422e942" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:38160 10.133.0.37:443 10.133.0.41:59636 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:53:21.740Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1382 47 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "08b6277b-3bb1-4d1f-8fff-dd5f633b66e7" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:50326 - opendatahub.maas-api-route.1 2026-07-06T15:53:34.614937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.614987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.626994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.627116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.632448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.632487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.647584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.647704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.647804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.649577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.649635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:34.649646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.651030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.651090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:34.651101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:34.677973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.678011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.686183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.686292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.689614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.689649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.703627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.703757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.703854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.706238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.706291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:34.706302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.707199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:34.707248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:34.707259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 [2026-07-06T15:53:34.629Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 19 - "10.133.0.41" "Go-http-client/1.1" "83810e66-8fba-4e5a-b315-4d5073c938d4" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.133.0.43:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:38160 10.133.0.37:443 10.133.0.41:59636 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-simulated-kserve-route.6 [2026-07-06T15:53:34.613Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 477 37 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "4e64db03-caef-4157-a329-206c24fa1abc" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:46230 - opendatahub.maas-api-route.1 [2026-07-06T15:53:34.687Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 18 - "10.133.0.41" "Go-http-client/1.1" "908a0923-7df1-41ab-8edb-fc9c6a53180c" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.134.0.47:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:39696 10.133.0.37:443 10.133.0.41:59636 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-distinct-2-simulated-kserve-route.6 [2026-07-06T15:53:34.676Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 354 30 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9427f273-8d01-4442-a748-8c6706e53a87" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:46242 - opendatahub.maas-api-route.1 2026-07-06T15:53:39.798235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:39.798286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:39.800229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:39.800270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:53:39.796Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 3 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "159cf420-0935-486f-ae67-80a283e0b935" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.37:443 10.134.0.9:42462 - opendatahub.maas-api-route.1 2026-07-06T15:53:53.357463Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.357515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.368897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.369018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.369238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.372562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.372621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:53.372633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.399558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.399590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.408339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.408472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.408739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.408774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.410440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.410467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.410707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.414452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.414627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.414802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.415416Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.435159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.435193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.444345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.444457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.444707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.444737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.445352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.445373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.445592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.447091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.447205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.447359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.447782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.471099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.471131Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480219Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.480999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.509436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.509477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.518644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.518749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.518972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.519004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.519590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.519612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:53:53.355Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 16 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "b0ccd57d-4432-464e-9d9b-aa647b77468a" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:55954 10.133.0.37:443 10.134.0.9:41992 - opendatahub.maas-api-route.1 [2026-07-06T15:53:53.397Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 17 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "5beebf11-ff0a-4c76-a199-62a750fcae78" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.132.0.22:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40210 10.133.0.37:443 10.134.0.9:41996 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-06T15:53:53.433Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 14 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "12f9348c-f125-4d59-bf99-4bcc65ce4b44" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.132.0.22:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:33032 10.133.0.37:443 10.134.0.9:42004 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-06T15:53:53.469Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 11 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "f3ef66dc-113b-40eb-9533-7d061d74950b" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.132.0.22:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:33032 10.133.0.37:443 10.134.0.9:42008 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-07-06T15:53:53.507Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 12 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "81aa45ba-3f1a-44f5-8f40-09cfc5f13c10" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.132.0.22:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.37:443 10.134.0.9:42010 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-07-06T15:53:53.540051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.540083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.545364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.545453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.548278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.548315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.556435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.556579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.556674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.557962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.558019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-06T15:53:53.558031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-06T15:53:53.558900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:53:53.558949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:53:53.558960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:53:53.546Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 11 - "10.133.0.41" "Go-http-client/1.1" "b39403dd-2d8a-4d04-bcc1-a09ed7815da8" "maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local" "10.132.0.22:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.37:40210 10.133.0.37:443 10.133.0.41:59636 maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 [2026-07-06T15:53:53.538Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 554 20 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "a77a7256-540a-4788-939d-913863b7f052" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:42016 - opendatahub.maas-api-route.1 2026-07-06T15:53:58.645721Z info ads ADS: new connection for node:4 2026-07-06T15:53:58.648903Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-07-06T15:53:58.648941Z info cache read certificate from file resource=file-root:system 2026-07-06T15:54:05.429331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.429380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.441345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.441467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.441712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.446446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.446509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:54:05.446552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:54:05.427Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 18 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "87040e76-90cf-926d-a970-337c380029e2" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "10.133.0.41:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.37:37148 10.133.0.37:443 10.134.0.9:41630 - opendatahub.maas-api-route.1 2026-07-06T15:54:05.829774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.829818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.861911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.861952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.892389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.892430Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.893731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.893761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.922067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.922106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.932487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.932620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.932861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.932892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.934386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.934409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:05.934656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:54:05.827Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 35 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "9494c673-d54a-48c2-982c-8600f3a8921f" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.37:443 10.134.0.9:41644 - llm.maas-e2e-external-model.0 [2026-07-06T15:54:05.890Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 3 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "21dc564d-71c7-485c-b99d-0b75eae19e18" "maas.apps.e37760d6-8ead-421e-9a75-723256ad2427.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.37:443 10.134.0.9:41654 - llm.maas-e2e-external-model.0 2026-07-06T15:54:08.887872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 2026-07-06T15:54:08.888042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=24 2026-07-06T15:54:08.888056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=24 [2026-07-06T15:54:05.919Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 2968 - "44.212.242.249,10.134.0.9" "python-requests/2.32.5" "47bc4147-0e5a-4fe1-b7de-b727e4b593c5" "httpbin.org" "3.225.230.69:443" outbound|443||httpbin.org 10.133.0.37:35454 10.133.0.37:443 10.134.0.9:41658 - llm.maas-e2e-external-model.0 2026-07-06T15:54:22.652007Z info ads ADS: "" 4 terminated 2026-07-06T16:08:10.906148Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2