2026-04-16T20:58:25.743776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T20:58:25.743784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:25.743795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T20:58:25.743802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:25.744776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:25.744818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:25.744849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T20:58:25.744857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T20:58:25.736Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.2" "Go-http-client/1.1" "7673bd6d-c756-4bdc-9db0-2175d3127cf5" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:40514 10.133.0.45:443 100.64.0.2:31272 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T20:58:25.730Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 14 - "100.64.0.2" "python-requests/2.32.5" "275bab32-59db-4cc5-8892-248095e0ab1c" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:43718 10.133.0.45:443 100.64.0.2:38508 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:58:34.903447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.903527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.908754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.908879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.909036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.911081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.911130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:58:34.911162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T20:58:34.911172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T20:58:34.902Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 8 - "100.64.0.4" "python-requests/2.32.5" "bfa9d43b-57a3-4351-aa0b-0fc2d40f54f6" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.4:58900 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:58:51.172013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.172064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.176431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.176575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.177278Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.177325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:58:51.177355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T20:58:51.177365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T20:58:51.170Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 6 - "100.64.0.4" "python-requests/2.32.5" "50f1f4a7-37d4-49c4-bcb9-ea7d5e0996c8" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:43718 10.133.0.45:443 100.64.0.4:17150 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:59:08.194910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.194960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.200191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.200313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.201066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.201113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:08.201146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T20:59:08.201155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T20:59:08.193Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 7 - "100.64.0.2" "python-requests/2.32.5" "a5a4c146-0afc-4a43-9d00-3cede336bb04" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.2:9966 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:59:25.361289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.361338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.366355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.366511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.367311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.367364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:25.367394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T20:59:25.367403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T20:59:25.360Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 7 - "100.64.0.3" "python-requests/2.32.5" "3423cd50-cd72-4f39-bd8a-a7a7d88f6c1b" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.3:22636 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:59:42.749882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.749932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.754779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.754902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.755644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.755693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T20:59:42.755724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T20:59:42.755733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T20:59:42.748Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 7 - "100.64.0.3" "python-requests/2.32.5" "36fca717-c57e-4a0a-8847-b1973d97c1b5" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.3:5732 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T20:59:56.757067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.757115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.762357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.762506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.762821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.767104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.767157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T20:59:56.767190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T20:59:56.767198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T20:59:56.755Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 11 - "100.64.0.4" "python-requests/2.32.5" "7ed0cb9a-e189-41cf-a30b-f506c19750c9" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:45560 10.133.0.45:443 100.64.0.4:20410 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:00:04.803611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.803659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.816487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.816613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.837955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.837995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.843806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.843936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.844045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.844617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.844666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.844700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:04.844709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.845589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.845631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:04.845662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:04.845670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:00:04.836Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 7 - "100.64.0.2" "Go-http-client/1.1" "0803b762-d6c0-40e8-b291-8af3d62728ba" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:43976 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-16T21:00:04.802Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 342 43 - "100.64.0.2" "python-requests/2.32.5" "cec5fea4-9412-4f02-9722-b54c6bda1459" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.2:2572 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:00:19.012220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.012271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.017946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.018083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.018275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.020046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.020107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.020153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:19.020168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:00:19.011Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 9 - "100.64.0.4" "python-requests/2.32.5" "6924e235-22b8-41a7-a2e4-debf27c0a8a7" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.4:37612 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:00:19.043878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.043925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.048313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.048435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.048613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.050561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.050616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:19.050659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:19.050672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:00:19.042Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 7 - "100.64.0.3" "python-requests/2.32.5" "b481ed2a-51fa-4360-a411-376056db7c4c" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.3:31000 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:00:27.083292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.083343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.086721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.086839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.090365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.090399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.095883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.096004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.096102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.096671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.096718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.096750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:27.096758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.098298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.098339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.098373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:27.098384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.122249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.122288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.124934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.125042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.126948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.126979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.132346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.132476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.132572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.134641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.134686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.134717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:27.134726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:27.136585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.136633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:00:27.136666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:00:27.136676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T21:00:27.089Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 7 - "100.64.0.2" "Go-http-client/1.1" "8e75ca77-41dc-4160-88b9-b15ee79fad0d" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:43976 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-16T21:00:27.082Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 16 - "100.64.0.4" "python-requests/2.32.5" "e205ec6e-58dd-4662-bbfe-c1dfdf4b6dd9" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.4:54520 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T21:00:27.126Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 8 - "100.64.0.2" "Go-http-client/1.1" "62c865f0-f999-4b4b-b253-6e4019323824" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:59352 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-16T21:00:27.121Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 15 - "100.64.0.2" "python-requests/2.32.5" "b3f99a1a-cc85-4bee-898b-24814d97d399" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:45560 10.133.0.45:443 100.64.0.2:27710 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:00:43.622681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.622738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.632388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.632566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.635021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.635062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.643993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.644108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.644673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.644719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.644754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:43.644762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.646741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.646771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.655153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.655258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.655760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.655800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.655830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:43.655838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.657691Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.657720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.665701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.665806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.666317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.666355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.666383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:43.666391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.667304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.667343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:00:43.667379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:00:43.667389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:00:43.633Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "100.64.0.2" "Go-http-client/1.1" "955afe0c-82e4-4961-b32c-bfd82b9a86d4" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:43976 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-16T21:00:43.646Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.2" "Go-http-client/1.1" "eb296da1-feff-4b55-b240-08b05ec7aa0f" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:59352 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-16T21:00:43.657Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 9 - "100.64.0.2" "Go-http-client/1.1" "9b34725e-545b-4afd-a9f6-ad7039904d72" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50644 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T21:00:43.621Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 45 - "100.64.0.3" "python-requests/2.32.5" "17aab58f-bd6b-40e2-9398-767e7d290105" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.3:64602 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:01:00.277642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.277700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.283480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.283621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.286871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.286908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.296714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.296848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.297407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.297459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.297512Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:00.297522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.299134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.299198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.299246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:01:00.299260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:00.322539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.322576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.328194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.328317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.330221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.330262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.339522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.339632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.340107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.340151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.340182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:00.340191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.341116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.341153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:00.341181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:00.341190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:01:00.285Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "100.64.0.2" "Go-http-client/1.1" "fcc0e4a4-12e2-4e42-9fcf-2002d807e087" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.32:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:43976 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-16T21:01:00.276Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 22 - "100.64.0.4" "python-requests/2.32.5" "741eb9bf-329f-4b40-bb72-2863abba3af8" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:45560 10.133.0.45:443 100.64.0.4:31622 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T21:01:00.329Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "100.64.0.2" "Go-http-client/1.1" "9355baae-6744-40ee-90af-08aa4c97c7d7" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:59352 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-16T21:01:00.321Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 19 - "100.64.0.2" "python-requests/2.32.5" "bb07d78b-7150-4747-aa15-f75c970c3710" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.2:15900 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:01:09.392125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:09.392177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:09.393325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:09.393358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:01:09.391Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.3" "python-requests/2.32.5" "9c40bf1b-7676-417b-a7bf-17b9d8b21819" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.45:443 100.64.0.3:53868 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:01:26.040734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.040790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.049659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.049807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.049990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.054693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.054744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.054777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:26.054785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.078122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.078170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.085657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.085784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.086100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.086134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.087998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.088029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.088226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.088837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.088958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.089056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.089239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.089827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.112209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.112246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.118436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.118569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.118822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.118853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.119253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.119277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.119444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.119964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.120078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.120173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.120335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.120778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:01:26.039Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 15 - "100.64.0.3" "python-requests/2.32.5" "69051651-93f8-46fd-8a00-1cdb40082ff5" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.3:9636 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T21:01:26.077Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 12 - "100.64.0.4" "python-requests/2.32.5" "1fe98474-0436-4fb8-b512-88f8eff2313e" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.30:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50982 10.133.0.45:443 100.64.0.4:12306 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T21:01:26.111Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 9 - "100.64.0.2" "python-requests/2.32.5" "1d030a5c-39df-4af3-8d96-0b6d87d33e8d" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.30:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50982 10.133.0.45:443 100.64.0.2:22616 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-04-16T21:01:26.137277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.137312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.143206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.143317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.143579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.143607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.143992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.144020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.175364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.175407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.181480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.181601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.181872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.181905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.182362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.182385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:26.201961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.201998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.204744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.204847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.206990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.207022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.212514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.212626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.212719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.214695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.214741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.214774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:26.214783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.216324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.216360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:26.216389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:26.216398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:01:26.136Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "92596c09-6f3b-4a64-b252-29cc26faafb1" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.30:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50982 10.133.0.45:443 100.64.0.3:3214 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T21:01:26.174Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.4" "python-requests/2.32.5" "b3c80e4e-b407-4bb7-87b7-ac37a9508f8f" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.30:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:33378 10.133.0.45:443 100.64.0.4:12308 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-16T21:01:26.206Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "61bb5143-fe99-4acc-8119-cd09cb1517f3" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.30:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:38462 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T21:01:26.200Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 15 - "100.64.0.2" "python-requests/2.32.5" "1b739550-555f-46d0-811b-a7ee77a51f76" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.2:22622 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:01:35.146144Z info ads ADS: new connection for node:6 2026-04-16T21:01:35.148510Z info cache read certificate from file resource=file-root:system 2026-04-16T21:01:41.936053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.936104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.941923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.942046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.942207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.944444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.944505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:01:41.944542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:01:41.944551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-16T21:01:41.934Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 9 - "100.64.0.2" "python-requests/2.32.5" "0ed18685-ebee-4517-8000-a1e41a6d94c6" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:49906 10.133.0.45:443 100.64.0.2:62212 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:01:42.368793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.368850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.369871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.369913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.392414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.392492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.409112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.409160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.433255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.433304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.440220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.440349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.440673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.440708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.442645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.442683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.443177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.452002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.452207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:01:42.452332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:01:42.452347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T21:01:42.367Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.3" "python-requests/2.32.5" "fd8b9485-f10c-4e59-ab6d-0c636de90d0c" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.45:443 100.64.0.3:32818 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-04-16T21:01:42.391Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 17 - "100.64.0.4" "python-requests/2.32.5" "a92b4c98-7f5c-46e8-8551-9df054d5ebce" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.45:443 100.64.0.4:53730 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-04-16T21:01:42.432Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 20 - "100.64.0.4" "python-requests/2.32.5" "2bd3dc97-5290-4672-b8cf-e46c6b40b270" "httpbin.org" "32.194.101.183:443" outbound|443||httpbin.org 10.133.0.45:54480 10.133.0.45:443 100.64.0.4:26978 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.e2e-external-model.0 2026-04-16T21:02:20.108821Z info ads ADS: "" 6 terminated 2026-04-16T21:02:22.309046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.309098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.316046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.316162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.316447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.328422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.328518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.328559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:02:22.328568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.373304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.373348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.377186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.377305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.379150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.379183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.384947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.385084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.385189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.385781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.385828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.385859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-16T21:02:22.385868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.386856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.386917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.386953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:02:22.386963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T21:02:22.307Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 321 20 - "100.64.0.3" "curl/7.76.1" "b8f4de5e-8cd7-4c55-af5c-cc4e1d8fa48e" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:37482 10.133.0.45:443 100.64.0.3:32664 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-16T21:02:22.378Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.2" "Go-http-client/1.1" "3eab2c5c-ceb5-42e3-aabd-9539ad7f9fdc" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50644 10.133.0.45:443 100.64.0.2:40920 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-16T21:02:22.372Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 14 - "100.64.0.2" "curl/7.76.1" "636d5f8b-4a01-4370-aef4-04285eeeec6d" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:37482 10.133.0.45:443 100.64.0.2:53160 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-16T21:02:22.440568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.440614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.447060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.447211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.447522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.447553Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.449962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.449986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.450179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.450861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.450998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.451103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.451281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.451700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.490740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.490787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.496998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.497148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.497489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.497524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.498069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.498093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.498296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.498928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.499066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.499170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.499350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.499712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.525230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.525266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.531702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.531842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.532087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.532116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.532520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.532543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.532713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.533324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.533455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.533572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.533742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.534092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.561292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.561331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.567699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.567834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.568066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.568095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.568530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.568554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.568721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.569311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.569437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.569579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.569750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.570103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.596755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.596792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.603086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.603223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.603517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.603549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.603977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.604000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.630652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.630687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.636922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.637062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.637321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.637352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.637734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.637757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.662558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.662594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.668828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.668965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.669215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.669245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.669674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.669700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.695318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.695363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.701722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.701858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.702121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.702150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.702612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.702638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.726536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.726569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.732256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.732390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.732664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.732696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.733138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.733167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.762513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.762546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.768757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.768889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.769137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.769166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.769611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.769634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.795266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.795309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.801290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.801429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.801737Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.801776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.802176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.802200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-16T21:02:22.829415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.829456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.830372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.830408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.855900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.855935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.860916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.861018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.863797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.863855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 2026-04-16T21:02:22.863892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=19 2026-04-16T21:02:22.863901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=19 [2026-04-16T21:02:22.439Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 496 11 - "100.64.0.2" "curl/7.76.1" "ae476d7f-9287-4afa-8966-e048c2f5f55c" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50644 10.133.0.45:443 100.64.0.2:24706 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.490Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 355 9 - "100.64.0.3" "curl/7.76.1" "989e0995-6d9d-4bdf-b5ec-f1d404be2559" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:40514 10.133.0.45:443 100.64.0.3:15556 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.524Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 365 9 - "100.64.0.4" "curl/7.76.1" "e0668791-67b7-4e7d-ada6-e862cf0450bd" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:40514 10.133.0.45:443 100.64.0.4:26130 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.560Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 538 9 - "100.64.0.4" "curl/7.76.1" "8380d79e-5a39-479d-bc98-e928739023c7" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:40514 10.133.0.45:443 100.64.0.4:44226 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.596Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "6efbf747-4bf5-4ae8-91d6-246645000198" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:50644 10.133.0.45:443 100.64.0.3:53638 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.630Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "7fbbadd1-8f05-4a34-9664-1183c5092c8d" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.45:443 100.64.0.2:24714 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.661Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "06f9daf2-c25c-48c9-8d5d-7369b1b3f04e" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:40514 10.133.0.45:443 100.64.0.3:15564 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.694Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "f5bca425-e1c9-4f0a-a5d8-04e17adb83ba" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.45:443 100.64.0.4:26144 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.725Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "2c690369-3d34-4cd5-90cf-e3700996e995" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:55938 10.133.0.45:443 100.64.0.2:46878 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.761Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "8c4591fd-bf70-4f5a-979b-74c9c22448cc" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.45:443 100.64.0.2:24728 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.794Z] "POST /v1/chat/completions HTTP/2" 429 - - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "7b9c93e1-7da5-434d-b890-a0e08ffd0e6b" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.45:55952 10.133.0.45:443 100.64.0.3:15578 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.828Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 - - "-" 100 0 1 - "100.64.0.4" "curl/7.76.1" "5e6fc4d3-156a-434b-bfb0-22a1c3b7fcbb" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.45:443 100.64.0.4:44230 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-04-16T21:02:22.854Z] "DELETE /v1/api-keys/0cf2fb25-6586-468b-aa40-28bbe3be0e73 HTTP/2" 200 - via_upstream - "-" 0 334 8 - "100.64.0.4" "curl/7.76.1" "5fd7e600-eb98-4ef7-81d6-c0cf6c269f83" "maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.45:37482 10.133.0.45:443 100.64.0.4:26154 maas.apps.f94ab0a6-eb4f-47bb-8683-e5a072ed3edb.prod.konfluxeaas.com opendatahub.maas-api-route.1