2026-06-02T03:00:38.560587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.560682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.560840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.563728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.563776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:38.563786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.582992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.583025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.592113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.592226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.592376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.595063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.595119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:38.595130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.614237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.614273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.624159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.624257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.626090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.626120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.627862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.627890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.628798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.628841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:38.628848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.647910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.647942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.649617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.649647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.722095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.722132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.723738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.723766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.747250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.747282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.748924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.748952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.805592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.805627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.817036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.817134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.817320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:00:37.818Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 189 1487 16 - "100.64.0.3" "python-requests/2.32.5" "43c82eaf-a613-4fa2-8d0a-fa0e73ce8196" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18552 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:37.854Z] "DELETE /v1/api-keys/c0409a84-3cb8-44a8-a9c8-564e291d646c HTTP/1.1" 200 - via_upstream - "-" 0 289 14 - "100.64.0.3" "python-requests/2.32.5" "a61c869c-0670-4b50-9b02-39460b137511" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:49292 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:37.892Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 26 310 14 - "100.64.0.4" "python-requests/2.32.5" "70cefefb-8164-4985-b1fc-a788211f3f0e" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42806 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:37.932Z] "GET /v1/api-keys/d7b83c24-3504-48cc-a144-2cf4f08c1c2f HTTP/1.1" 404 - via_upstream - "-" 0 29 12 - "100.64.0.2" "python-requests/2.32.5" "6eee0c01-a8e2-4059-8b48-dc4749b4b1a1" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:36436 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:37.972Z] "DELETE /v1/api-keys/d7b83c24-3504-48cc-a144-2cf4f08c1c2f HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "100.64.0.3" "python-requests/2.32.5" "6fdd34bc-6763-479e-80a5-06765c6c570d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49300 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.012Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 23 308 14 - "100.64.0.2" "python-requests/2.32.5" "cc2593e7-e134-4378-b30d-3cf4c5461638" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:54976 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.045Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 23 308 14 - "100.64.0.4" "python-requests/2.32.5" "bcdbfc9b-1347-4808-9b09-b3da662c56db" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:42812 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.077Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 23 307 14 - "100.64.0.2" "python-requests/2.32.5" "832f17d1-73ca-45fa-b9d4-dea56ba40056" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:36440 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.109Z] "GET /v1/api-keys/8d686275-a6d2-483c-90c8-463a08551d98 HTTP/1.1" 200 - via_upstream - "-" 0 283 13 - "100.64.0.4" "python-requests/2.32.5" "8e7a1122-ac93-4487-a9e9-3e8ddd296092" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19896 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.140Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 200 - via_upstream - "-" 65 130 15 - "100.64.0.3" "python-requests/2.32.5" "eac8639f-f075-44da-826d-35f6186e8064" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:49308 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.174Z] "GET /v1/api-keys/8d686275-a6d2-483c-90c8-463a08551d98 HTTP/1.1" 200 - via_upstream - "-" 0 284 14 - "100.64.0.3" "python-requests/2.32.5" "a4777798-5288-486d-b9ba-b04729dc5de5" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18562 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.205Z] "GET /v1/api-keys/f089cce6-4fb2-40e9-aff1-6318d5e2695c HTTP/1.1" 200 - via_upstream - "-" 0 284 13 - "100.64.0.4" "python-requests/2.32.5" "dfd7ee16-8eb1-4284-9c29-ecf2f190072d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42826 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.237Z] "GET /v1/api-keys/34938c46-9479-4e61-bde6-90128dec2954 HTTP/1.1" 200 - via_upstream - "-" 0 284 12 - "100.64.0.2" "python-requests/2.32.5" "5dc6b2c2-d0a7-4202-b643-bbdded9eeca5" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:36452 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.272Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 403 - via_upstream - "-" 29 69 13 - "100.64.0.2" "python-requests/2.32.5" "592be30b-99f5-4355-a731-a8548bcc1793" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:54982 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.305Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 319 14 - "100.64.0.4" "python-requests/2.32.5" "592580e0-8156-9490-b5a6-ad6c0bfa996d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19900 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.334Z] "GET /v1/api-keys/5453b910-1046-48e6-aed0-6ed20f010254 HTTP/1.1" 200 - via_upstream - "-" 0 294 12 - "100.64.0.3" "python-requests/2.32.5" "a68fab2f-9ec4-43a7-a57a-2d9ec753bf49" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18574 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.363Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 200 - via_upstream - "-" 65 130 14 - "100.64.0.3" "python-requests/2.32.5" "ad3c182b-28fb-4562-ad50-14e2a9c7edb2" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:49316 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.397Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 100 313 13 - "100.64.0.2" "python-requests/2.32.5" "44e31ca4-1b74-4369-8aca-e571b4184877" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:54988 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.429Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 106 310 14 - "100.64.0.4" "python-requests/2.32.5" "da06e57c-cdb5-4115-a8e9-bd018afff094" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:19908 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.485Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 127 114 12 - "100.64.0.4" "python-requests/2.32.5" "756a0763-28ac-4353-a42a-5a061e5a519a" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42830 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.516Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 76 314 13 - "100.64.0.2" "python-requests/2.32.5" "e824819d-34b8-4b69-bec3-c6354615a923" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:36460 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.550Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 102 317 13 - "100.64.0.3" "python-requests/2.32.5" "47ef6f4a-87ca-4919-ac6c-b8ba1c12b545" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49330 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.581Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 76 319 13 - "100.64.0.3" "python-requests/2.32.5" "d72da8e3-721b-4f9d-bf7e-e14542353291" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18582 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.625Z] "GET /llm/facebook-opt-125m-simulated/v1/models HTTP/1.1" 403 - - "-" 0 0 2 - "10.132.0.28" "Go-http-client/1.1" "2f18034c-84bb-42b6-8753-626b4eead1ec" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 10.132.0.28:48024 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.3 [2026-06-02T03:00:38.613Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 15 - "100.64.0.4" "python-requests/2.32.5" "3fea2eed-2f04-432f-8a07-b7ef5c493268" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:42832 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.647Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 0 2 - "100.64.0.2" "python-requests/2.32.5" "e78630de-381a-4d2c-984d-595512b4e361" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.2:36472 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:38.721Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.3" "python-requests/2.32.5" "dc5d2638-ace7-4534-a19f-300161724377" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.3:49332 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:38.746Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.4" "python-requests/2.32.5" "0108319d-3098-45dd-b172-25635a739de1" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.4:42848 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-06-02T03:00:38.820758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.820818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:38.820834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.839330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.839363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.841277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.841304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:38.858574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.858606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.869435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.869539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.872965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:38.873010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:38.873020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:00:38.804Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 16 - "100.64.0.2" "python-requests/2.32.5" "bec1d33e-a700-47a9-8e32-73277ee6176e" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:55004 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:38.838Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.4" "python-requests/2.32.5" "af1bfe73-9b1c-4a68-835d-3fa475d297ff" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.4:19916 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:38.857Z] "DELETE /v1/api-keys/0cfbbe25-2583-41f6-848e-f1112cdf3760 HTTP/1.1" 200 - via_upstream - "-" 0 294 15 - "100.64.0.3" "python-requests/2.32.5" "1a44f520-b674-466c-bbb6-811429b3704e" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18592 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:00:40.895449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:40.895496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:40.897433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:40.897465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:40.921452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.921491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.923309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.923341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.942945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.942981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.953693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.953800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.953982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.957516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.957568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:40.957578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.976346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.976378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.986418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.986520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.990101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:40.990173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:40.990183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.012031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.012077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.021712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.021833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.023973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.024024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.024033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.048447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.048490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.071381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.071510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.073517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.073575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.073586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.094284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.094324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.103794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.103906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.104088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.107123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.107206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.107218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.126826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.126863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.136403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.136513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.139905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.139959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.139969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.156362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.156396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.167455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.167557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.167719Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.170665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.170717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.170728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.189330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.189362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.190774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.190802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.208875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.208908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.210368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.210396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.250660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.250701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.260325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.260465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.260687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.263807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.263861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.263872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.281458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.281494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.291369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.291477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.291643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.294633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.294683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.294692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.313101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.313135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.323448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.323558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.323730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.326643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.326694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.326704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.345701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.345736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.355724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.355824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.359735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.359783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.359794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.378884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.378918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.390405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.390513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.393790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.393839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.393849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.412740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.412774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.424762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.424873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.428233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.428290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.428301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.448545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.448586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.458472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.458579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.458754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.461821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.461875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.461886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.481475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.481509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.491270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.491366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.491532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.494343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.494396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.494408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.512056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.512090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.521998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.522097Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.522285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.525168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.525217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.525226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.543341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.543371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.545003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.545031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.811720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.811767Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:00:40.894Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 3 - "100.64.0.2" "python-requests/2.32.5" "6ebfa48e-a451-4b94-a636-19c2d309369b" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.2:36484 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:40.920Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/1.1" 403 - - "-" 100 0 2 - "100.64.0.2" "python-requests/2.32.5" "8122d6da-3237-41d4-9e2f-d0f40a35e131" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.2:55014 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-02T03:00:40.941Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 15 - "100.64.0.4" "python-requests/2.32.5" "71b1a1e7-f26b-4956-a2f9-725550b09e21" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19932 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:40.975Z] "DELETE /v1/api-keys/daee2219-e079-46d3-a379-880fe9e6cb2d HTTP/1.1" 200 - via_upstream - "-" 0 291 14 - "100.64.0.3" "python-requests/2.32.5" "ec82e061-1cd4-961b-899e-95c1c8b081ad" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:49346 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.010Z] "DELETE /v1/api-keys/daee2219-e079-46d3-a379-880fe9e6cb2d HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "100.64.0.4" "python-requests/2.32.5" "00ec94e1-ad6a-4aeb-bf3f-9c99a6a3eeef" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42856 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.047Z] "DELETE /v1/api-keys/nonexistent-uuid-12345 HTTP/1.1" 404 - via_upstream - "-" 0 29 26 - "100.64.0.2" "python-requests/2.32.5" "e1682d0f-3fda-4c39-9e6f-d8aea146f5b9" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:36498 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.093Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 14 - "100.64.0.3" "python-requests/2.32.5" "1bb5544e-d32f-46df-92e5-462177d5be88" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49350 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.125Z] "DELETE /v1/api-keys/1f9391e9-7660-4638-a95a-b515c3c024ef HTTP/1.1" 200 - via_upstream - "-" 0 293 14 - "100.64.0.4" "python-requests/2.32.5" "6ec79541-64a5-473e-bab8-d2f2abc503d7" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:42870 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.155Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 15 - "100.64.0.3" "python-requests/2.32.5" "006ee52b-0c84-4d66-9c2d-56ca3904755c" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18594 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.188Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.2" "python-requests/2.32.5" "9fcdd81c-ae18-45e8-8ec3-acbef9c66d5e" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.2:36510 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:41.208Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.3" "python-requests/2.32.5" "30867496-2601-49bf-a0b4-8ded2f5c0a27" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.3:49366 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-02T03:00:41.249Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 14 - "100.64.0.2" "python-requests/2.32.5" "3ce52c33-dcd3-41d6-b695-da6a8ceb8810" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:55024 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.280Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 14 - "100.64.0.4" "python-requests/2.32.5" "9b5aacf7-6708-4f31-8e51-968702f09b81" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19948 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.311Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 14 - "100.64.0.4" "python-requests/2.32.5" "49c27e1f-312b-4cf0-aaed-8e9a3d5cabb1" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42880 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.344Z] "DELETE /v1/api-keys/43b5a077-a3fc-45e9-accb-93cafff4514f HTTP/1.1" 200 - via_upstream - "-" 0 288 15 - "100.64.0.2" "python-requests/2.32.5" "c0a5832a-2fc5-430c-b52d-9c7eca50e365" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:36520 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.377Z] "DELETE /v1/api-keys/06c4daf9-2352-4545-83c1-8093238ce19a HTTP/1.1" 200 - via_upstream - "-" 0 288 16 - "100.64.0.3" "python-requests/2.32.5" "38bd5ee1-e9ac-427b-89aa-74ced58f8c75" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:49368 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.411Z] "DELETE /v1/api-keys/698c4c1b-2089-4673-ab0c-468e68a6aa94 HTTP/1.1" 200 - via_upstream - "-" 0 288 16 - "100.64.0.3" "python-requests/2.32.5" "16ca718a-2866-4160-825c-3facd96b9877" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:18606 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.447Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "100.64.0.2" "python-requests/2.32.5" "6948e149-ded9-4e58-b660-befabddd146d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:55040 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.480Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 14 - "100.64.0.4" "python-requests/2.32.5" "cb185e38-6383-4465-90a2-4049c4c4f562" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:42888 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.510Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "100.64.0.4" "python-requests/2.32.5" "a3dc54b8-f151-40f6-935c-65b66629f376" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19950 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.542Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "100.64.0.2" "python-requests/2.32.5" "1301fb2f-a3cd-4cdb-ab24-0028385bd29f" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.2:36534 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0 2026-06-02T03:00:41.823043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.823192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.823394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.826668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.826725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:00:41.826735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:00:41.847742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.847781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.858622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.858735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.858918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.864091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.864195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.864211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.883510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.883543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.894083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.894215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.894376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.896283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.896355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.896369Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.918860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.918894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.929371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.929469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.929623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.932538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:41.932588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:41.932598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.318138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.318204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.329742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.329861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.331798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:42.331855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:42.331865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T03:00:41.810Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 322 16 - "100.64.0.3" "python-requests/2.32.5" "60b31aab-e4e2-4b49-ac59-3a58f209b613" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49382 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.846Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 103 3153 17 - "100.64.0.3" "python-requests/2.32.5" "4c6d0484-9e4b-4b98-b0d3-a99a7e3cac28" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.3:18622 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.882Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 77 2855 14 - "100.64.0.2" "python-requests/2.32.5" "2a695852-fdb4-4c5f-bab4-448094a4abf5" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:55050 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:41.917Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 320 14 - "100.64.0.4" "python-requests/2.32.5" "a7ca5231-caa2-4f98-bc4a-5d4c209ed482" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:42890 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:42.316Z] "GET /v1/api-keys/81201f8a-9f57-48a6-af71-76f50a3d849f HTTP/1.1" 200 - via_upstream - "-" 0 296 15 - "100.64.0.4" "python-requests/2.32.5" "096ed3e8-00ad-414f-9676-dad70c0816e0" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.4:19954 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:00:45.082447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.082503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.094481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.094620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.094843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.098496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:00:45.098552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:00:45.098564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T03:00:45.081Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 310 17 - "100.64.0.2" "python-requests/2.32.5" "aba94156-5ea7-48c0-b3c0-b7fdf0643f62" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36904 10.133.0.40:443 100.64.0.2:41930 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:00:56.230Z] "- - -" 0 NR filter_chain_not_found - "-" 0 0 0 - "-" "-" "-" "-" "-" - - 10.133.0.40:443 100.64.0.3:9508 pubwp-origin-stage-us-east-1.k.system1.company - 2026-06-02T03:01:04.243780Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.243828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.261171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.261286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.261485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.264909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:04.264966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:01:04.264977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:01:04.242Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 313 22 - "100.64.0.3" "python-requests/2.32.5" "71bdfc72-7528-4e3e-a740-1dc52a932c36" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:5894 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:01:23.543918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.543963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.560444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.560558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.560749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.562599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:23.562652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:01:23.562662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:01:23.542Z] "POST /v1/api-keys HTTP/1.1" 403 - via_upstream - "-" 68 100 20 - "100.64.0.2" "python-requests/2.32.5" "a23bfbed-723a-4e5b-8945-bd2c6ba6951c" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:40794 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:01:42.849352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.849410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.863962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.864114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.864374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.867859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:01:42.867926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:01:42.867942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:01:42.848Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 19 - "100.64.0.4" "python-requests/2.32.5" "b481baa6-4d08-4dc8-af7f-a0831035c905" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:2190 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:01:52.674102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.674174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.685331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.685447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.685635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.689171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:01:52.689226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:01:52.689236Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T03:01:52.672Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 16 - "100.64.0.4" "python-requests/2.32.5" "5e63ab1e-c519-4aaf-9bf0-2f0c3949cca8" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.4:10086 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:02:14.394837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.394883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.409998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.410122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.410342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.414161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.414218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:14.414228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.438835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.438882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.466104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.466233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.466411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.469907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.469959Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:14.469969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.488644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.488681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.498831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.498936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.499104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.502137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.502216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:14.502226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.524895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.524928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.534110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.534240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.534403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.539532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.539593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:14.539607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.562167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.562198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.572283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.572376Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.575896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.575946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:14.575956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.598193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.598227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.607831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.607932Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.611203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.611250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:14.611260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:14.633849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.633890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.643297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.643395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.646570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:14.646615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:14.646624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:02:14.393Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 20 - "100.64.0.3" "python-requests/2.32.5" "1093fb58-2992-4bc9-9f95-daf1e74c472d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49858 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.436Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 33 - "100.64.0.2" "python-requests/2.32.5" "59430577-dea1-4c0a-b4ca-c9d9f1504eec" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.2:23508 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.487Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "100.64.0.2" "python-requests/2.32.5" "0ce2899d-fc23-4d2d-95b5-a477cd51ab19" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:28614 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.523Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 122 332 15 - "100.64.0.3" "python-requests/2.32.5" "83f5c3ae-fe40-47a2-814c-802c1c1272a3" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:54482 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.561Z] "DELETE /v1/api-keys/2086a714-165d-469d-a344-48fdd6a01c6a HTTP/1.1" 200 - via_upstream - "-" 0 289 14 - "100.64.0.4" "python-requests/2.32.5" "405d0e5e-b736-4874-8a77-321f5e32d558" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.4:54702 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.596Z] "DELETE /v1/api-keys/7737ccef-0878-4b77-b8af-e3928455833b HTTP/1.1" 200 - via_upstream - "-" 0 289 14 - "100.64.0.4" "python-requests/2.32.5" "8ff7ecd7-e005-4910-ba9f-3635dd83f73c" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.4:24874 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:14.632Z] "DELETE /v1/api-keys/4504d948-f64f-4f38-8f04-9174ad66ac48 HTTP/1.1" 200 - via_upstream - "-" 0 289 14 - "100.64.0.3" "python-requests/2.32.5" "6e5dc83e-4241-4e65-a731-f13705ccd171" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:49862 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:02:23.666665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.666714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.677816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.677936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.678128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.681902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.681956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:23.681966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.700363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.700396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.710231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.710324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.710469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.713291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.713336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:23.713346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.736106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.736139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.745632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.745722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.745863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.750453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.750529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:23.750545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.767317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.767353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.776008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.776110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.779212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.779257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:23.779267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:23.797454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.797487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.806402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.806493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.809591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.809640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:23.809651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.833101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.833133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.842272Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.842366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.842509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.845254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:23.845301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:23.845311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T03:02:23.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 16 - "100.64.0.2" "python-requests/2.32.5" "882984c1-1aaa-4fba-95c9-ab69e926ef3d" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.2:47310 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:23.699Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 14 - "100.64.0.2" "python-requests/2.32.5" "505160ca-bc37-45e3-9770-bce65a1d1442" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.2:16856 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:23.735Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 77 3429 15 - "100.64.0.4" "python-requests/2.32.5" "bd726a44-0ef6-4bce-80bd-ef367a5ecf46" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.4:35910 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:23.766Z] "DELETE /v1/api-keys/769025bc-2a26-47af-837b-1b2469a2ddc3 HTTP/1.1" 200 - via_upstream - "-" 0 287 13 - "100.64.0.3" "python-requests/2.32.5" "c75cd285-7e5e-43e6-b3bf-9352fe07a308" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.3:19206 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:23.796Z] "DELETE /v1/api-keys/f13c96a7-3df8-4db6-b02c-9a11f496f595 HTTP/1.1" 200 - via_upstream - "-" 0 287 13 - "100.64.0.2" "python-requests/2.32.5" "2325b361-f853-4f99-899d-063e6f935e50" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.2:16868 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:02:23.832Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 13 - "100.64.0.4" "python-requests/2.32.5" "e90e5a82-49cc-41b9-a294-209e1a5478e0" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.4:35916 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:02:24.092795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.092841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.107548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.107662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.107852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.109450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:02:24.109506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:02:24.109517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-02T03:02:24.091Z] "POST /internal/v1/subscriptions/select HTTP/1.1" 200 - via_upstream - "-" 115 310 18 - "100.64.0.3" "python-requests/2.32.5" "57fe8b35-69cc-493a-9faa-0da11993f387" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:46076 10.133.0.40:443 100.64.0.3:19214 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:02:40.580120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.580195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.584195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.584319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.584531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.586086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:02:40.586175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:02:40.586190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:02:40.578Z] "POST /internal/v1/subscriptions/select HTTP/1.1" 200 - via_upstream - "-" 114 91 7 - "100.64.0.2" "python-requests/2.32.5" "ec3ea940-015c-478b-b2f3-b74294421c73" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:36894 10.133.0.40:443 100.64.0.2:28840 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-06-02T03:03:49.542066Z info ads ADS: new connection for node:4 2026-06-02T03:03:49.547357Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-06-02T03:03:49.547394Z info cache read certificate from file resource=file-root:system 2026-06-02T03:04:06.117608Z info ads ADS: "" 4 terminated 2026-06-02T03:04:20.659184Z info ads ADS: new connection for node:5 2026-06-02T03:04:20.661754Z info cache read certificate from file resource=file-root:system 2026-06-02T03:04:37.316622Z info ads ADS: "" 5 terminated with stream closed 2026-06-02T03:04:51.214666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.214710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.241844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.241982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.248457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.248531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-02T03:04:51.248542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-02T03:04:51.274773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.274816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.284480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.284605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.284802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.289038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.289094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-02T03:04:51.289104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.312395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.312428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.313979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-02T03:04:51.314006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-02T03:04:51.213Z] "DELETE /v1/api-keys/c12e7887-7332-428e-95f6-b988b66a2b04 HTTP/1.1" 200 - via_upstream - "-" 0 327 35 - "100.64.0.3" "python-requests/2.32.5" "57cde1f5-1955-4d6d-9995-3edc5955f54f" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:45006 10.133.0.40:443 100.64.0.3:55194 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:04:51.273Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "100.64.0.4" "python-requests/2.32.5" "5efa2c43-68ed-4138-912b-d2f94985ad14" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "10.132.0.28:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.40:45014 10.133.0.40:443 100.64.0.4:36662 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-06-02T03:04:51.311Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 2 - "100.64.0.3" "python-requests/2.32.5" "da6a087b-ae23-4fc8-b3ea-24c2425e142c" "maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 100.64.0.3:17188 maas.apps.1eec4977-7d66-4a5f-a39b-93614906bf8f.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.0