2026-06-03T01:02:50.719877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.739678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.739720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.750014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.750146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.750353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.752002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.752055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:50.752065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.773170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.773209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.783409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.783558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.783762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.786611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.786667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:50.786678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.809574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.809612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.819906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.820034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.820235Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.822988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.823043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:50.823053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:50.842024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.842063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.852496Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.852646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.852845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.855395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.855448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:50.855458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.874189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.874229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.884421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:50.884559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T01:02:50.473Z] "GET /v1/api-keys/fc3e517f-4b63-4e44-a8d5-1ccd8e4f79ab HTTP/1.1" 200 - via_upstream - "-" 0 284 17 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "811f74e8-fa58-4854-a34f-7ca2feb1449d" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52708 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.515Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 403 - via_upstream - "-" 29 69 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "4a6da4a0-2177-4325-8c1b-ae156e97a898" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52720 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "780a5159-343f-42b5-ab60-4c2bf3f2901d" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52736 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.603Z] "GET /v1/api-keys/c0b47d87-ca10-4785-a58a-fc2c11650b88 HTTP/1.1" 200 - via_upstream - "-" 0 294 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "b0a302c2-f566-491e-8e48-3ba14b0c33a2" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52742 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.633Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 200 - via_upstream - "-" 65 130 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "612dc573-11ee-4124-999b-01de62b8812a" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52746 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.670Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 100 314 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "99dbb788-e103-488f-a42a-d7b45092c966" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52756 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.705Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 106 309 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "198bcc0b-1ae8-4c95-89ed-03926a5665b7" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52764 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.738Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 127 114 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "d0ced687-c53c-4b6d-a5e3-8b24ac282c28" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52778 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.772Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 76 314 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "3f4bf338-fc54-445b-905f-0235963d3ee6" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52794 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.808Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 102 317 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "0fec46fa-0a06-4966-a8cf-4fa4248fba30" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52806 - opendatahub.maas-api-route.1 [2026-06-03T01:02:50.841Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 76 318 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "f7da7099-3ca0-430a-ae4d-23a69b4c1efc" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52808 - opendatahub.maas-api-route.1 2026-06-03T01:02:51.635202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.635276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:51.635285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.655692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.655735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.657508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.657560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.760243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.760287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.761901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.761934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.780581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.780617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.782154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.782187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.817645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.817687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.828214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.828360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.828625Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.834033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.834095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:51.834106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:51.851215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.851254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.852799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.852830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.869469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.869509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.880891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.881026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.884581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:51.884638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:51.884648Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T01:02:50.873Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 761 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "5fe760ea-8e29-4171-96ce-b2c1faa138fe" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52812 - opendatahub.maas-api-route.1 [2026-06-03T01:02:51.654Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "6687b6fc-3435-48e9-8c56-528d92022857" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52826 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:51.759Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "21381be4-9242-4a44-ab3c-a681bb338805" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52838 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:51.779Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "381c6e7c-1bed-4e0c-a213-d7f5a2ae8add" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52848 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:51.816Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 17 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "1d254935-71af-4bac-9b5a-0753aaf2dc69" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52858 - opendatahub.maas-api-route.1 [2026-06-03T01:02:51.850Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "90b54d20-1d53-4d8a-8a93-7be108cb05c3" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52866 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:51.868Z] "DELETE /v1/api-keys/0b3335c7-a496-44f6-9a6a-5e73c30505ae HTTP/1.1" 200 - via_upstream - "-" 0 294 16 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "18aaf596-1a06-4f54-8b97-11e32e22ddc3" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52876 - opendatahub.maas-api-route.1 2026-06-03T01:02:53.904583Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.904626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.906296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.906331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.930702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.930744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.932405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.932437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.952019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.952063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.962801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.962936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.963160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.966344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.966403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:53.966415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:53.983630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:53.983673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:53.993898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:53.994030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:53.997348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:53.997404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:53.997414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.016589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.016628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.028276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.028420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.030848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.030908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.030918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.052576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.052616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.063414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.063564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.065481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.065561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.065575Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.085782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.085820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.095958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.096074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.096258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.098847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.098899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.098909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.116929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.116964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.127055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.127169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.130041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.130093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.130104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.149093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.149128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.158880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.158995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.159173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.161653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.161704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.161714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.179411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.179446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.180917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.180949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.197867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.197900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.199315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.199343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.238444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.238485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.248592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.248725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.248942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.251933Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.251989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.252000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.269492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.269564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.279628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.279761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.279974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.282675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.282732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.282742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.299992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.300035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.309750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.309873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.310063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.312556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.312609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.312619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.330594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.330631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.340371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.340494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.343486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.343573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.343585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.361878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.361917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.372586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.372707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.375777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.375832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.375842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.393694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.393733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.404800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.404919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.407821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.407875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.407885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.428319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.428361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.438765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.438899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.439107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.441750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.441807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.441817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.459872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.459923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.470717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.470870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.471122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.474043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.474107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.474117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T01:02:53.903Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "d9bb56d9-8384-443b-aa0c-2b2b76fe1a04" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52888 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:53.929Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/1.1" 403 - - "-" 100 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "e44d2150-9f1a-9238-bbc5-e71796e49c4c" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52892 - llm.facebook-opt-125m-simulated-kserve-route.1 [2026-06-03T01:02:53.951Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "50c0dbdc-4967-4360-9eb3-7c2189208d60" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52896 - opendatahub.maas-api-route.1 [2026-06-03T01:02:53.982Z] "DELETE /v1/api-keys/158b8e39-1411-4aa6-93b4-8a0893d11024 HTTP/1.1" 200 - via_upstream - "-" 0 291 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "9b286071-8238-4eb7-bbf4-846301131293" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52900 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.015Z] "DELETE /v1/api-keys/158b8e39-1411-4aa6-93b4-8a0893d11024 HTTP/1.1" 404 - via_upstream - "-" 0 29 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "825877c5-d28c-48c0-83ed-d6da394ea67a" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52906 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.051Z] "DELETE /v1/api-keys/nonexistent-uuid-12345 HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "99ae3d46-44e3-4490-a04f-64ab462b8b18" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52914 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.084Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "19c7dda7-686c-4f25-8a1b-57421b4bbf05" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52922 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.116Z] "DELETE /v1/api-keys/c7564c7e-ff19-4aa1-a4d3-1b29569a9d79 HTTP/1.1" 200 - via_upstream - "-" 0 293 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "b836b90f-4d46-4cc1-bb8e-efe68039a5c8" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52938 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.148Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "ddf5511a-0673-4203-b289-890f82df207b" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52946 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.178Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "7dcc8c96-942a-4609-917e-6f99ccd33e5f" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52954 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:54.197Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "d39f9e81-b4f5-480d-b8d1-a160861711e6" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:52962 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:54.237Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "3a84c95c-3085-4d86-9690-d296d61f68f2" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52968 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.268Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "7dbaf943-f544-48b4-90d8-26d5320c998c" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:52978 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.299Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "0bb98d80-8199-400a-a11b-5a486161b83c" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:52994 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.329Z] "DELETE /v1/api-keys/89bdb9dc-8568-4e08-b690-fcaec33eb1aa HTTP/1.1" 200 - via_upstream - "-" 0 288 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "b77ebb8e-18be-4887-869f-395c3a13efb1" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53004 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.360Z] "DELETE /v1/api-keys/cc4c3c46-febc-4da2-97bb-0892ff053cb4 HTTP/1.1" 200 - via_upstream - "-" 0 288 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "a713451a-3742-47b2-8045-e2e9ae65b26b" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53020 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.392Z] "DELETE /v1/api-keys/0a69bd42-2a73-4c07-9c22-5d6d82f3596d HTTP/1.1" 200 - via_upstream - "-" 0 288 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "805f52f7-6cc5-4040-b458-5c7bd8541070" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53022 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.427Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "b7881a80-70dc-41d7-b878-7deb7e7fa248" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53026 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.458Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "f358c0f1-302c-917b-b5d3-cda58eff827d" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53042 - opendatahub.maas-api-route.1 2026-06-03T01:02:54.492818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.492869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.502965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.503103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.503322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.506096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.506158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.506169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.523794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.523837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.525664Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.525697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.793619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.793671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.805225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.805363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.805627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.808428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.808498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.808542Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.825396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.825438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.835497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.835658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.835861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.841499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.841629Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.841647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.858492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.858555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.869214Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.869336Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.869556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.871730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.871806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:02:54.871821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:02:54.893672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.893708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.903821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.903949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.904154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.906781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:54.906835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:54.906845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.321676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.321724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.332423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.332596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.334701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.334773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:55.334789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:02:54.491Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "52196042-a26c-4877-9ee7-f56be0f88ab2" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53056 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.523Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 65 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "45b1f1d9-3f2d-4b91-a9d3-a974b5311aba" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:53062 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-06-03T01:02:54.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 322 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "a8abd855-029b-4dc2-9b8f-969527255fb9" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53072 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.824Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 103 3153 17 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "7d8c17f9-cf6f-4346-b2a9-40902cb8b8b7" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53078 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.857Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 77 2855 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "cfca3b5d-1f49-484b-883d-ebc77448ae37" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:41296 10.134.0.26:443 10.132.0.17:53086 - opendatahub.maas-api-route.1 [2026-06-03T01:02:54.892Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 321 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "97f2d55b-4e1d-4cd9-aacd-e41b2a157254" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53092 - opendatahub.maas-api-route.1 [2026-06-03T01:02:55.320Z] "GET /v1/api-keys/076ad99e-26ea-4ee0-b5e5-7370e997c4ad HTTP/1.1" 200 - via_upstream - "-" 0 296 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "3a2bc9e6-206f-4a7a-a6a2-f75d00416790" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53106 - opendatahub.maas-api-route.1 2026-06-03T01:02:55.964354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.964400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.975138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.975281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.975510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.978295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:02:55.978355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:02:55.978366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:02:55.963Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "dbf1e9ac-9149-44c6-8642-1b70e1f3ff7d" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53110 - opendatahub.maas-api-route.1 2026-06-03T01:03:15.077636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.077693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.093464Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.093651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.093906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.097315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:15.097388Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:03:15.097399Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:03:15.076Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 20 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "c79e040f-5b5e-4d85-8ceb-25cedd3ae2dd" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:55950 - opendatahub.maas-api-route.1 2026-06-03T01:03:34.343460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.343538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.360683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.360832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.361071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.363037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:34.363093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:03:34.363103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:03:34.342Z] "POST /v1/api-keys HTTP/1.1" 403 - via_upstream - "-" 68 100 20 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "68748862-36fa-45bd-bf21-a37bed621584" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:53544 - opendatahub.maas-api-route.1 2026-06-03T01:03:53.617816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.617868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.632122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.632275Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.632559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.635837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:03:53.635900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:03:53.635911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:03:53.616Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 19 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "079b85ed-9b7d-4dc6-b442-6cccbe687d21" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:56296 - opendatahub.maas-api-route.1 2026-06-03T01:04:03.330607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.330657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.342386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.342564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.342814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.344794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:03.344853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:03.344864Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:04:03.329Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "d2c0102e-1e42-4ba0-a7b6-287840f119d8" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:46424 - opendatahub.maas-api-route.1 2026-06-03T01:04:24.996679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:24.996726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.012447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.012626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.012869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.016224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.016284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.016295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.045084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.045126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.055749Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.055901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.056141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.059043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.059103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.059114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.078337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.078379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.087875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.088001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.088199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.090998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.091053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.091064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.114675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.114718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.124844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.124972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.125187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.130818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.130886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.130896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.151580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.151630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.162910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.163060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.168431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.168509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:25.168544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:25.186956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.187004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.197018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.197168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.200297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.200354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.200365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.218112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.218149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.227863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.227994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.231033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:25.231090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:25.231101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:04:24.995Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 20 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "ee5ba9a5-6c69-49b9-a10d-f8021eeb61aa" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36334 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.044Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "572bfcb6-cace-4060-842d-9e51b5045fe7" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36348 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.077Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "e415e14a-a384-4ff2-a2de-bb4a0c273a8d" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36360 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.113Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 122 332 17 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "920c81e0-ee23-4482-b4b5-f082f2b228bd" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36366 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.150Z] "DELETE /v1/api-keys/ac3561b7-1d2b-44cc-960c-55d478fa5c3d HTTP/1.1" 200 - via_upstream - "-" 0 289 18 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "e881f4d7-9370-48cc-8a8d-5de9979d6e10" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:36368 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.186Z] "DELETE /v1/api-keys/739a2dca-7534-43cd-8efa-bc6ef15cd094 HTTP/1.1" 200 - via_upstream - "-" 0 289 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "f5b708c8-dfa3-448f-830a-b2059c21eed6" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36378 - opendatahub.maas-api-route.1 [2026-06-03T01:04:25.217Z] "DELETE /v1/api-keys/be50e59b-385d-4982-ae33-8752ddf12701 HTTP/1.1" 200 - via_upstream - "-" 0 289 13 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "a3f77558-ea65-4172-bf8e-4cadeaaaaf43" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:36382 - opendatahub.maas-api-route.1 2026-06-03T01:04:34.241007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.241074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.252546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.252697Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.252943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.256425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.256487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.256498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.274475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.274549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.284750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.284889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.285120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.287958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.288016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:34.288027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:34.308340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.308386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.318374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.318573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.318824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.324145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.324240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.324256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.345653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.345695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.355930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.356070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.359574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.359633Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.359643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.377896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.377937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.387968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.388103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.391373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.391441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.391453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.413584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.413627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.425351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.425492Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.425742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.428510Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.428597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.428608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T01:04:34.240Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 310 16 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "2b787353-523c-4c4e-ae38-9edda3d13a4f" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33294 - opendatahub.maas-api-route.1 [2026-06-03T01:04:34.273Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 310 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "c5cd01e9-230c-4b60-85fb-17b2f4c1d794" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:33308 - opendatahub.maas-api-route.1 [2026-06-03T01:04:34.307Z] "POST /v1/api-keys/search HTTP/1.1" 200 - via_upstream - "-" 77 3429 16 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "2ef76ba2-a142-4219-915f-4539e3229778" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33316 - opendatahub.maas-api-route.1 [2026-06-03T01:04:34.344Z] "DELETE /v1/api-keys/a5ded239-42e6-4309-9e60-20cf689bff0c HTTP/1.1" 200 - via_upstream - "-" 0 287 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "4fdc0191-7637-494c-b840-895845ae6634" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33328 - opendatahub.maas-api-route.1 [2026-06-03T01:04:34.376Z] "DELETE /v1/api-keys/09156b82-84ad-43d1-a82c-f3bd3eddac53 HTTP/1.1" 200 - via_upstream - "-" 0 287 14 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "c8e648f8-0b60-450e-8651-e53b3f73e9fa" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33338 - opendatahub.maas-api-route.1 [2026-06-03T01:04:34.412Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 16 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "7ab75933-4db1-48a1-aa7c-9492056ee7c0" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33346 - opendatahub.maas-api-route.1 2026-06-03T01:04:34.661562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.661607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.675812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.675966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.676215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.677905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-06-03T01:04:34.677967Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-06-03T01:04:34.677978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-06-03T01:04:34.660Z] "POST /internal/v1/subscriptions/select HTTP/1.1" 200 - via_upstream - "-" 115 310 17 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "87e1eb2d-7935-4ea1-96ab-e57613d0e4de" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:50124 10.134.0.26:443 10.132.0.17:33358 - opendatahub.maas-api-route.1 2026-06-03T01:04:51.155759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.155810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.160055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.160213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.160446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.162158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:04:51.162216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:04:51.162227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:04:51.154Z] "POST /internal/v1/subscriptions/select HTTP/1.1" 200 - via_upstream - "-" 114 91 7 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "46b87bc5-76da-46b3-92ed-1554d6d4565a" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:42660 10.134.0.26:443 10.132.0.17:37544 - opendatahub.maas-api-route.1 2026-06-03T01:05:59.321393Z info ads ADS: new connection for node:4 2026-06-03T01:05:59.324068Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-06-03T01:05:59.324109Z info cache read certificate from file resource=file-root:system 2026-06-03T01:06:15.829088Z info ads ADS: "" 4 terminated 2026-06-03T01:06:30.138586Z info ads ADS: new connection for node:5 2026-06-03T01:06:30.140742Z info cache read certificate from file resource=file-root:system 2026-06-03T01:06:46.669682Z info ads ADS: "" 5 terminated with stream closed 2026-06-03T01:07:00.667004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.667054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.689971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.690120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.706058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.706128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:07:00.706139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.731624Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.731667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.742279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.742421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.742666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.745808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.745874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-06-03T01:07:00.745890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.775612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.775647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.777311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-06-03T01:07:00.777342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-06-03T01:07:00.666Z] "DELETE /v1/api-keys/fe03ae82-e9bc-4fb7-bace-352d2ba1ed0f HTTP/1.1" 200 - via_upstream - "-" 0 327 40 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "c7570bda-4411-44b0-a513-f742a3fbae6b" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:33792 10.134.0.26:443 10.132.0.17:46086 - opendatahub.maas-api-route.1 [2026-06-03T01:07:00.730Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "156e6944-9c03-4a75-bc79-a3b382b81585" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "10.133.0.47:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.26:33792 10.134.0.26:443 10.132.0.17:46088 - opendatahub.maas-api-route.1 [2026-06-03T01:07:00.774Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 2 - "34.228.250.194,10.132.0.17" "python-requests/2.32.5" "80a173fe-a5b8-4a23-971d-4959a1ce0719" "maas.apps.5d41e0e1-c786-4960-afe8-36741a971141.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.26:443 10.132.0.17:46098 - llm.facebook-opt-125m-simulated-kserve-route.0