[2026-04-21T00:36:31.792Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 12 - "100.64.0.3" "python-requests/2.32.5" "61be034d-7f30-4a05-946a-f07a631618e5" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:55654 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:36:39.842462Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.842510Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.846529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.846670Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.848542Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.848575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.854833Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.854952Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.855045Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.855643Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.855689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.855721Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:39.855730Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.856757Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.856806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.856836Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:39.856845Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.876224Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.876255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.879212Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.879323Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.880918Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.880957Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.887034Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.887149Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.887239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.904419Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.904460Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.904487Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:39.904496Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.906267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.906305Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:39.906334Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:39.906343Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:36:39.847Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "100.64.0.4" "Go-http-client/1.1" "23d920d6-5599-47d6-9fbe-97590653b7e0" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:46352 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-21T00:36:39.841Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 15 - "100.64.0.3" "python-requests/2.32.5" "b5d9fa65-4930-4257-91e5-fe02b6e905d8" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.3:32084 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:36:39.880Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 24 - "100.64.0.4" "Go-http-client/1.1" "0d8df44a-1354-4a4c-a617-ee59afba3d7f" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.56:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:52282 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-21T00:36:39.875Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 31 - "100.64.0.2" "python-requests/2.32.5" "73bbcdf1-8653-4da1-b7c9-28d770417a4a" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.2:58642 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:36:56.459088Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.459144Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.472932Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.473064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.475145Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.475180Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.484202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.484321Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.484945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.484994Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.485029Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:56.485039Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.487218Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.487253Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.495708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.495818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.496203Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.496244Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.496273Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:56.496282Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.498185Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.498220Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.506656Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.506758Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.509729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.509772Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.509799Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:56.509808Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.510768Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.510809Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:36:56.510845Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:36:56.510855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:36:56.474Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "100.64.0.4" "Go-http-client/1.1" "28fa8c84-88ea-4bb9-8024-498fc4216cd0" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:46352 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-21T00:36:56.486Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.4" "Go-http-client/1.1" "7beb3b49-36fd-4409-8bef-f1ffe2e3e857" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.56:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:52282 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-21T00:36:56.497Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "100.64.0.4" "Go-http-client/1.1" "37bd51f3-527e-4771-9ba0-bc08c1e4e9f5" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:36:56.457Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 52 - "100.64.0.4" "python-requests/2.32.5" "aad2505f-2ecc-45a4-aaef-7325cf74484b" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:59876 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:37:12.950980Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.951032Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.964720Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.964850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.966939Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.966978Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.976785Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.976915Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.977476Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.977531Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.977567Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:37:12.977576Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:12.978661Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.978708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:12.978742Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:37:12.978752Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.009457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.009492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.018693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.018790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.020537Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.020570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.028944Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.029054Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.029428Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.029469Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.029500Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:37:13.029509Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:13.030481Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.030523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:13.030555Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:37:13.030564Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-21T00:37:12.966Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 11 - "100.64.0.4" "Go-http-client/1.1" "26369a84-78fd-461a-b4d9-f582d7bc3d86" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:46352 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-21T00:37:12.949Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 28 - "100.64.0.3" "python-requests/2.32.5" "d2385952-b655-4fc5-ac12-e4754c1cb02b" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:19080 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:37:13.019Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.4" "Go-http-client/1.1" "b1cc5391-6de4-48f9-9ff4-9d96d952e806" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.56:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:52282 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-21T00:37:13.008Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 22 - "100.64.0.2" "python-requests/2.32.5" "645f03d0-85e7-4eb9-9a52-8cd1c28ccf30" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:32426 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:37:22.078462Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:22.078509Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:22.079783Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:22.079817Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:37:22.077Z] "GET /maas-api/v1/models HTTP/1.1" 401 -  - "-" 0 0 2 - "100.64.0.4" "python-requests/2.32.5" "8be9ed78-e810-4c65-8b6d-b02a2a016460" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.41:443 100.64.0.4:9686 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:37:38.721798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.721953Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.738437Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.738592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.738831Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.742903Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.742955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.742989Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:37:38.742999Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.769582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.769635Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.776558Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.776705Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.776961Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.776992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.778412Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.778437Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.778599Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.779071Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.779175Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.779266Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.779435Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.779966Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.799900Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.799930Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.805769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.805880Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.806099Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.806126Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.806526Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.806548Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.824740Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.824771Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.830761Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.830873Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.831090Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.831117Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.831504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.831531Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:38.849207Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.849245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.851908Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.852029Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.854105Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.854139Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.859375Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.859496Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.859595Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.859971Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.860011Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.860041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:37:38.860050Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.861751Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.861797Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:38.861830Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:37:38.861840Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:37:38.719Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 23 - "100.64.0.2" "python-requests/2.32.5" "3b2c11ee-51a0-4a34-b9be-7841cddf242f" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:62482 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:37:38.769Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 10 - "100.64.0.4" "python-requests/2.32.5" "19bbfbdc-3a76-40a8-b586-481b3d13e96f" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:39402 10.133.0.41:443 100.64.0.4:60976 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-21T00:37:38.799Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.3" "python-requests/2.32.5" "cecadcbc-7071-4084-bae7-45267041e174" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:39402 10.133.0.41:443 100.64.0.3:34952 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-21T00:37:38.824Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "31b5acbc-0128-4501-8e57-30fd45e98ef7" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.41:443 100.64.0.2:18418 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-21T00:37:38.853Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 6 - "100.64.0.4" "Go-http-client/1.1" "6f933186-5b4d-4e82-ae4e-7e592622c5cd" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:48058 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:37:38.848Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 13 - "100.64.0.4" "python-requests/2.32.5" "30eb6fe6-2cce-47a5-9bda-a0f1a74fe708" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:37254 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:37:47.737599Z	info	ads	ADS: new connection for node:6
2026-04-21T00:37:47.740164Z	info	cache	read certificate from file	resource=file-root:system
2026-04-21T00:37:52.423150Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.423199Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.437599Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.437793Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.437975Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.441331Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.441384Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.441417Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:37:52.441427Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.809883Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.809923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.810874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.810911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:37:52.832075Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.832112Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.832937Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.832966Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.855723Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.855762Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.862530Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.862667Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.862915Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.862945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.864422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.864445Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.864874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.873680Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.873814Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:37:52.873923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:37:52.873937Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:37:52.422Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 19 - "100.64.0.3" "python-requests/2.32.5" "88267f7a-cf70-4233-91d7-8c34f96c2b3b" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:60388 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:37:52.808Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "7c9e7a08-53aa-40c2-9fa5-e3ba6b1b6ff7" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.41:443 100.64.0.2:51100 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-21T00:37:52.831Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 1 - "100.64.0.4" "python-requests/2.32.5" "c9dafefa-cb7f-4dd4-bc55-6d67815876e6" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.133.0.41:443 100.64.0.4:46896 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-21T00:37:52.854Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 19 - "100.64.0.3" "python-requests/2.32.5" "13fa89fb-f473-4aee-b536-06a14190c55d" "httpbin.org" "18.235.15.99:443" outbound|443||httpbin.org 10.133.0.41:55972 10.133.0.41:443 100.64.0.3:59834 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.e2e-external-model.0
2026-04-21T00:38:30.445951Z	info	ads	ADS: "" 6 terminated
2026-04-21T00:38:30.601703Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.601753Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.604256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.604374Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.604529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.616104Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.616154Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.616188Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:30.616197Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.763588Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:30.763654Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:30.787448Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:30.787494Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:30.814321Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.814360Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.815635Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.815664Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.841030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.841064Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.842267Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:30.842294Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:38:30.600Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 15 - "100.64.0.2" "python-requests/2.32.5" "f271504d-8de4-49ca-81a2-f9247e817427" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.2:6628 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:30.762Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 -  - "-" 37 0 25 - "100.64.0.3" "python-requests/2.32.5" "2526d4ca-e078-4b05-8121-ce664999defe" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.41:443 100.64.0.3:26624 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:30.813Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 -  - "-" 35 0 2 - "100.64.0.4" "python-requests/2.32.5" "5f4c0080-7899-4051-b2cd-28c8659e2b84" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.41:443 100.64.0.4:32472 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:30.840Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 -  - "-" 36 0 2 - "100.64.0.3" "python-requests/2.32.5" "f71c883a-a0ea-4505-bd25-903470928ab8" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.41:443 100.64.0.3:4212 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:38:31.494162Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.494211Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.496855Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.496981Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.497143Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.499473Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.499520Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.499554Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:31.499563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.876490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.876538Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.879086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.879202Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.879358Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.882529Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.882579Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.882634Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:31.882645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.901478Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.901511Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.905196Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.905295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.906862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.906892Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.912316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.912455Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.912548Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.913141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.913186Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.913216Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:31.913224Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.914237Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.914292Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.914339Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:31.914354Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:31.934279Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.934314Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.939823Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.939976Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.940239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.940280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.941692Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.941727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.941905Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.942534Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.942686Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.942800Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.942985Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:31.943502Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.106946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.107010Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.110382Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.110563Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.110836Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.113071Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.113124Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.113158Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:32.113167Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:32.135789Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.135824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.138263Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.138378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.142029Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.142080Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:32.142120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:32.142135Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:38:31.493Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 28 312 6 - "100.64.0.2" "python-requests/2.32.5" "b06f7e74-0d62-455b-b111-0f470ae4798f" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.2:47916 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:31.875Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 7 - "100.64.0.4" "python-requests/2.32.5" "1f0a5b3c-4ae0-4e87-9e1f-3e1c6ce93a8c" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:58962 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:31.906Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "590ffbba-f5a4-48cd-93a1-51888fb8fb1e" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:38:31.900Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 13 - "100.64.0.3" "python-requests/2.32.5" "1ad20e9b-9a24-4879-af60-80ed4d6aab77" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.3:26626 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:31.933Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 123 337 9 - "100.64.0.2" "python-requests/2.32.5" "eda402c8-8790-487e-ae35-4832ee684191" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:45608 10.133.0.41:443 100.64.0.2:6644 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-21T00:38:32.105Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 8 - "100.64.0.2" "python-requests/2.32.5" "08baf4c6-42cc-9a1f-95cb-ecdb9b545f0b" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:47930 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:32.134Z] "DELETE /v1/api-keys/feb4a196-9421-4bea-afa9-829e5f394ae4 HTTP/1.1" 200 - via_upstream - "-" 0 251 7 - "100.64.0.4" "python-requests/2.32.5" "22b43299-9f04-49d3-8ccf-f5f5d37dad9a" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:58972 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:38:35.166441Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.166492Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.170420Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.170507Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.171055Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.171106Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.171136Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:35.171144Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.350385Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.350448Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.363436Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.363475Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-21T00:38:35.165Z] "GET /v1/models HTTP/1.1" 500 - via_upstream - "-" 0 96 5 - "100.64.0.4" "python-requests/2.32.5" "45f2a831-5ebc-44b0-9984-dd499db28f43" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.4:32484 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.348Z] "POST /maas-api/v1/api-keys HTTP/1.1" 401 -  - "-" 38 0 14 - "100.64.0.3" "python-requests/2.32.5" "11019a55-c4f7-4c13-92c9-e6db4e756743" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.133.0.41:443 100.64.0.3:47636 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:38:35.631696Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.631758Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.634282Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.634405Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.634570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.636826Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.636877Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.636908Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:35.636918Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.659226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.659262Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.661874Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.661988Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.662135Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.664232Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.664283Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.664316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:35.664324Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.801987Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.802034Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.804748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.804863Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.805014Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.807195Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.807243Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.807276Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:35.807285Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:35.825578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.825628Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.827813Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.827914Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.830543Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.830587Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.830640Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:35.830650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.853793Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.853822Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.855955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.856043Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.857143Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.857181Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.857210Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:35.857218Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.998504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:35.998549Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.001073Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.001190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.001341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.003459Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.003503Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.003532Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.003541Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.021824Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.021868Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.024877Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.025011Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.026722Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.026759Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.032352Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.032503Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.032640Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.033228Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.033278Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.033322Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.033335Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.034333Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.034382Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.034422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.034435Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.184584Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.184646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.187379Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.187498Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.187668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.189688Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.189737Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.189769Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.189779Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.209086Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.209119Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.212201Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.212304Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.212732Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.212779Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.212808Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.212818Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.229895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.229926Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.232594Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.232735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.234447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.234480Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.241449Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.241593Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.241715Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.242345Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.242388Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.242418Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.242426Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.243602Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.243668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.243703Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.243713Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-21T00:38:35.629Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 34 318 7 - "100.64.0.2" "python-requests/2.32.5" "6606bb7d-99e7-4637-8356-a373505694b5" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:16030 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.658Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 32 316 6 - "100.64.0.3" "python-requests/2.32.5" "609d47e5-a306-4031-a1cc-36d34070e118" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:4226 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.800Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 6 - "100.64.0.4" "python-requests/2.32.5" "0d85fd07-af92-4475-81f7-8ef49c4cf9df" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:58410 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.824Z] "DELETE /v1/api-keys/c74b2e7a-37d4-408f-b68e-caa0470e4dbb HTTP/1.1" 200 - via_upstream - "-" 0 253 6 - "100.64.0.2" "python-requests/2.32.5" "d56544f5-46b4-4390-85c1-34ef65f6024a" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:6652 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.852Z] "DELETE /v1/api-keys/c74b2e7a-37d4-408f-b68e-caa0470e4dbb HTTP/1.1" 404 - via_upstream - "-" 0 29 4 - "100.64.0.4" "python-requests/2.32.5" "27ea0ddc-f8cf-419e-8686-03b38ecabc38" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.4:32498 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:35.997Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 6 - "100.64.0.3" "python-requests/2.32.5" "82c2b763-9615-42d2-873a-37fe5d78e00d" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:4240 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.025Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "67904cb8-7ec8-95e9-a6a6-cab0dbe550ec" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:38:36.020Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 13 - "100.64.0.2" "python-requests/2.32.5" "775ddb3c-6656-44b5-8abb-c9b5fa8c8b6a" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.2:6654 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.183Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 314 6 - "100.64.0.4" "python-requests/2.32.5" "e75fb165-4999-4022-8182-e4377f8a6e99" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.4:32500 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.208Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 4 - "100.64.0.3" "python-requests/2.32.5" "61d4ce87-abc2-457d-a87a-a7c170d7a23e" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:47646 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.233Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.4" "Go-http-client/1.1" "80634f18-7cdb-456c-a8ea-a497fe0c6894" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:38:36.229Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.3" "python-requests/2.32.5" "e2ff5af4-b90c-4ff7-bdf3-f5883c797b60" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.3:4246 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-21T00:38:36.409748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.409791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.412457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.412573Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.412749Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.414854Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.414903Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.414936Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.414945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.433319Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.433355Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.436223Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.436336Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.437999Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.438030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.443393Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.443531Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.443642Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.444184Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.444226Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.444256Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.444265Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.445205Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.445242Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.445271Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.445280Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.461432Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.461465Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.464110Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.464215Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.465813Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.465843Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.471231Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.471364Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.471450Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.471943Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.471980Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.472008Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.472017Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.472959Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.472998Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.473028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-21T00:38:36.473037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-21T00:38:36.620024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.620068Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.622776Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.622889Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.623040Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.625089Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.625134Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-21T00:38:36.625172Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-21T00:38:36.625181Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-21T00:38:36.408Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 29 313 6 - "100.64.0.2" "python-requests/2.32.5" "d26e2cc2-d230-459d-8457-6ecf7e07a253" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:6670 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.437Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "ab7c0049-4f29-483d-a5ea-8ca93ac4be00" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:38:36.432Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 12 - "100.64.0.4" "python-requests/2.32.5" "e9fb893c-2a0a-48f0-b233-cf816b4729f7" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.4:32508 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.465Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 6 - "100.64.0.4" "Go-http-client/1.1" "34e94591-5fb0-4651-ba32-90cada80595d" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.132.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.41:51258 10.133.0.41:443 100.64.0.4:43804 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-21T00:38:36.460Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 12 - "100.64.0.3" "python-requests/2.32.5" "a2e5fa17-3ad3-4555-8a3c-bcd37b7157e9" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:40136 10.133.0.41:443 100.64.0.3:4252 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-21T00:38:36.618Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 36 321 6 - "100.64.0.2" "python-requests/2.32.5" "ad6242a2-6d62-494e-8fb5-12818111c109" "maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com" "10.133.0.52:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.133.0.41:35158 10.133.0.41:443 100.64.0.2:16042 maas.apps.f262c479-3880-4b2f-bf75-c84306d88083.prod.konfluxeaas.com opendatahub.maas-api-route.1