2026-04-23T01:40:00.292271Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:00.292304Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:40:00.292312Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:39:59.587Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "b1d9c421-c880-4ef6-904a-fa2e11cd0d6c" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:59986 10.132.0.39:443 100.64.0.4:64402 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-23T01:39:59.581Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.3" "python-requests/2.32.5" "475e83f0-1f27-420f-97c0-dfeff776dad9" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.3:57324 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:40:00.283Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 320 8 - "100.64.0.2" "python-requests/2.32.5" "e38790f5-3802-4811-8f81-49b8f52300b2" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.2:38358 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:40:08.315947Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.316013Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.319487Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.319651Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.321679Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.321714Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.321727Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.327289Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.327412Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.327513Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.327589Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328175Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328197Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328232Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328245Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328275Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:40:08.328284Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.328295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:40:08.328300Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:08.329562Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.329646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:08.329698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:40:08.329712Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:40:08.320Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "9a2daed7-32d2-4936-96a9-8deb5560153b" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:59986 10.132.0.39:443 100.64.0.4:64402 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-23T01:40:08.314Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 14 - "100.64.0.4" "python-requests/2.32.5" "6725f06c-13e0-422e-9bb9-582e39a83407" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.4:23580 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:40:17.468453Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.468503Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.475396Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.475578Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.475840Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.478223Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.478276Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:17.478323Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:40:17.478333Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:40:17.467Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 327 11 - "100.64.0.3" "python-requests/2.32.5" "7febfcac-5b83-4a34-87d4-56a03202b643" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.3:13574 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:40:33.757572Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.757636Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.761217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.761331Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.762035Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.762081Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:40:33.762111Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:40:33.762120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:40:33.756Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 5 - "100.64.0.2" "python-requests/2.32.5" "16ca15ca-6a1f-46ce-bf7a-413cab02416b" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.2:55370 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:40:50.793006Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.793054Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.798748Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.798862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.799742Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.799789Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:40:50.799820Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:40:50.799829Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:40:50.791Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 7 - "100.64.0.4" "python-requests/2.32.5" "bbe6c069-5b56-472e-a8a3-94b9ce4c8adf" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.4:35950 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:41:07.937570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.937637Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.943500Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.943650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.944447Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.944496Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:07.944527Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:41:07.944536Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:41:07.936Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 8 - "100.64.0.2" "python-requests/2.32.5" "a52ce5c2-0817-41d3-95f7-8c89b9119808" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.2:45648 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:41:25.283378Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.283427Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.288635Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.288762Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.289605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.289670Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:25.289704Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:41:25.289713Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:41:25.282Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 7 - "100.64.0.3" "python-requests/2.32.5" "48b457cd-9f6d-46d8-9e7c-955d29f9ff76" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.3:3884 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:41:39.237399Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.237449Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.242585Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.242739Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.242904Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.245383Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.245428Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:41:39.245461Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:41:39.245469Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:41:39.236Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 330 9 - "100.64.0.3" "python-requests/2.32.5" "5990ec35-fa6b-42d3-90fa-505978822c8e" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.3:35282 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:41:47.275806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.275878Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.290229Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.290406Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.306175Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.306217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.312523Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.312722Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.312894Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.313546Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.313605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.313668Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:41:47.313681Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.314765Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.314814Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:47.314860Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:41:47.314871Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:41:47.304Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "100.64.0.2" "Go-http-client/1.1" "44325505-ebb8-49dd-92bb-d6dade6d4db9" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:53284 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-23T01:41:47.274Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 342 40 - "100.64.0.4" "python-requests/2.32.5" "a497d043-e444-422b-80f3-0ac88582338f" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.4:57336 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:41:59.269243Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.269293Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.274573Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.274735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.274901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.277253Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.277302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.277342Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:41:59.277352Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.294936Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.294968Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.299706Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.299804Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.299930Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.301998Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.302038Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:41:59.302069Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:41:59.302078Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:41:59.268Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 9 - "100.64.0.3" "python-requests/2.32.5" "5287d91d-d02b-4665-b6ee-071ea31d2404" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.3:45708 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:41:59.293Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 8 - "100.64.0.4" "python-requests/2.32.5" "5f50134b-3700-4256-8d7b-3ca7292d1fb7" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.4:7628 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:42:07.327058Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.327107Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.330706Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.330815Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.332857Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.332892Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.339131Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.339253Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.339359Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.339935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.339993Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.340028Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:07.340036Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.341055Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.341098Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.341128Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:42:07.341138Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.357795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.357827Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.360806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.360935Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.362684Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.362712Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.368708Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.368826Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.368922Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.390898Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.390951Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.390984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:07.390994Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:07.392909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.392955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:07.392984Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:42:07.392993Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:42:07.331Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 8 - "100.64.0.2" "Go-http-client/1.1" "1a4dc733-4450-416d-9f0a-8dd4121353d2" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:53284 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-23T01:42:07.325Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 15 - "100.64.0.2" "python-requests/2.32.5" "31a83ebe-6ecd-4e5d-89cd-e7799fd349b5" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.2:16650 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:42:07.361Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 29 - "100.64.0.2" "Go-http-client/1.1" "ae906fa4-e6d3-474d-bda9-76f8445d4b97" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:58788 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-23T01:42:07.356Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 36 - "100.64.0.4" "python-requests/2.32.5" "5d9b3841-f754-43d8-9e50-d2dc1118dbcf" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.4:5822 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:42:25.920791Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.920839Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.926160Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.926276Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.928317Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.928351Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.937018Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.937149Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.937759Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.937811Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.937849Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:25.937858Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.939883Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.939913Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.948920Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.949030Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.949599Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.949664Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.949698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:25.949707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.951514Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.951544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.980025Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.980175Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.980860Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.980912Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.980946Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:25.980955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:25.982037Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.982080Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:25.982120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:42:25.982130Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:42:25.927Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "100.64.0.2" "Go-http-client/1.1" "9eb80ccc-43f0-4338-89d3-09731ce98b1b" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:53284 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-23T01:42:25.939Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "100.64.0.2" "Go-http-client/1.1" "6478dd28-64c4-4494-93c7-00d0e6378878" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:58788 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-23T01:42:25.950Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 30 - "100.64.0.2" "Go-http-client/1.1" "e545c088-b027-4152-8f8b-a21fc22be68c" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:52636 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-23T01:42:25.919Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 62 - "100.64.0.2" "python-requests/2.32.5" "d171aa25-5eff-41a8-adb6-ca837e1f8de9" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.2:12202 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:42:42.404162Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.404210Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.409217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.409331Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.411355Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.411391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.419673Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.419795Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.420365Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.420412Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.420448Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:42.420457Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.421421Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.421463Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.421495Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:42:42.421504Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:42.448027Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.448061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.452302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.452410Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.454409Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.454443Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.462732Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.462885Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.463531Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.463575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.463637Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:42.463650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.464600Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.464666Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:42:42.464698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:42:42.464707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:42:42.410Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "100.64.0.2" "Go-http-client/1.1" "39bda667-9f5b-493d-b517-b3cda5dbe9ef" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.41:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:53284 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2
[2026-04-23T01:42:42.403Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 18 - "100.64.0.3" "python-requests/2.32.5" "84dbbe58-3589-4649-9f41-9f1e0c07e06a" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.3:8772 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:42:42.453Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 10 - "100.64.0.2" "Go-http-client/1.1" "7629b3fe-c67c-4d87-8861-c2e68d246069" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.38:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:58788 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2
[2026-04-23T01:42:42.446Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 17 - "100.64.0.4" "python-requests/2.32.5" "ab97fb01-f26d-4113-acd8-b8c20cf2de6e" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:53780 10.132.0.39:443 100.64.0.4:55498 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:42:51.506337Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:51.506387Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:51.507736Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:42:51.507770Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:42:51.505Z] "GET /maas-api/v1/models HTTP/1.1" 401 -  - "-" 0 0 2 - "100.64.0.3" "python-requests/2.32.5" "b6263727-7c2c-4a54-befd-81b5178fcc71" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.132.0.39:443 100.64.0.3:37464 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:43:08.121790Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.121838Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.128645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.128775Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.128936Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.132110Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.132155Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.132187Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:43:08.132197Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.155179Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.155217Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.163004Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.163120Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.163391Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.163424Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.164646Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.164674Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.165009Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.167311Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.167441Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.167544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.167752Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.168211Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.183714Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.183746Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.190218Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.190331Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.190592Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.190650Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.190990Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.191014Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.230389Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.230434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.236728Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.236854Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.237146Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.237180Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.237587Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.237645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.255928Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.255965Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.258936Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.259042Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.261575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.261626Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.267755Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.267870Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.267979Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.269812Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.269862Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.269897Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:43:08.269906Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:08.271642Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.271692Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:08.271729Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:43:08.271738Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
[2026-04-23T01:43:08.120Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 11 - "100.64.0.2" "python-requests/2.32.5" "b8c917b0-6c6a-4457-90f5-90b908b043c6" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.2:23048 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:43:08.154Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 13 - "100.64.0.4" "python-requests/2.32.5" "10a1708c-d9a2-49ce-bd7c-c36f6ba27ad7" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:55346 10.132.0.39:443 100.64.0.4:42546 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-23T01:43:08.183Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "f9655a85-4e55-441a-ada7-d8c962b7e36a" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:55346 10.132.0.39:443 100.64.0.2:16956 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-23T01:43:08.229Z] "POST /v1/completions HTTP/1.1" 429 -  - "-" 66 18 8 - "100.64.0.3" "python-requests/2.32.5" "0b591390-23a9-45b6-8ab8-b7551101d3b8" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:36692 10.132.0.39:443 100.64.0.3:59980 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0
[2026-04-23T01:43:08.261Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "33966830-33b1-4936-a4b5-3ffb9b98b80e" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:42278 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2
[2026-04-23T01:43:08.254Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 16 - "100.64.0.3" "python-requests/2.32.5" "56d34d12-3471-415e-abdd-482473e42020" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.3:47484 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
2026-04-23T01:43:17.106320Z	info	ads	ADS: new connection for node:6
2026-04-23T01:43:17.111023Z	info	cache	read certificate from file	resource=file-root:system
2026-04-23T01:43:23.842261Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.842309Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.847785Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.847949Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.848173Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.850600Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.850663Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:23.850698Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=17
2026-04-23T01:43:23.850707Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:24.204169Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:24.204213Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:24.205509Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:24.205543Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:43:24.235540Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.235583Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.236751Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.236783Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.254869Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.254911Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.261882Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.262013Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.262316Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.262352Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.263705Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.263732Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.264206Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.273240Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.273422Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:43:24.273526Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:43:24.273536Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:43:23.841Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 9 - "100.64.0.4" "python-requests/2.32.5" "41174aec-fbf1-4bf3-9f89-a6f9db70738f" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:60052 10.132.0.39:443 100.64.0.4:29018 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:43:24.203Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "816a308e-594c-413d-8b42-3956f1357960" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.39:443 100.64.0.2:23186 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-23T01:43:24.234Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 -  - "-" 83 0 2 - "100.64.0.4" "python-requests/2.32.5" "c1a9080d-496e-469d-bac5-85533d8e13d0" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.132.0.39:443 100.64.0.4:15290 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-external-model.0
[2026-04-23T01:43:24.253Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 19 - "100.64.0.3" "python-requests/2.32.5" "14a26201-81aa-479d-92cc-329d4c1bc66e" "httpbin.org" "98.84.87.4:443" outbound|443||httpbin.org 10.132.0.39:59112 10.132.0.39:443 100.64.0.3:12968 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.e2e-external-model.0
2026-04-23T01:44:01.904950Z	info	ads	ADS: "" 6 terminated with stream closed
2026-04-23T01:44:04.008655Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.008802Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.014456Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.014582Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.014895Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.028344Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.028413Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.028452Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:44:04.028461Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.070556Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.070596Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.074799Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.074909Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.077109Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.077141Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.083411Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.083544Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.083660Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.084260Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.084302Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.084335Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:44:04.084343Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.085295Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.085347Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.085381Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:44:04.085390Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.128901Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.128941Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.135633Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.135775Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.136044Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.136074Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.137255Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.137282Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.137462Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.138189Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.138321Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.138425Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.138605Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.138968Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.170923Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.170954Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.177945Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178076Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178308Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178337Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178645Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178667Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.178833Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.179452Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.179575Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.179693Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.179856Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.180134Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.202329Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.202362Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.209388Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.209515Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.209751Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.209780Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.210041Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.210061Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.210209Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.210867Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.210992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.211092Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.211254Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.211507Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.236744Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.236775Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.243434Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.243560Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.243806Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.243834Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.244096Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.244119Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.268488Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.268524Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.277463Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.277595Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.277852Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.277882Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.278168Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.278190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.302924Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.302955Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.309325Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.309448Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.309711Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.309743Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.309988Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.310009Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.335687Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.335716Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.342604Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.342742Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.342964Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.342992Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.343247Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.343269Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.373820Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.373850Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.380694Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.380816Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.381038Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.381065Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.381341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.381362Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=17
2026-04-23T01:44:04.403307Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.403341Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.409996Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.410128Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.410362Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.410390Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.410688Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.410711Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.433417Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.433451Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.440339Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.440470Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.440744Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.440781Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.441084Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.441106Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.463206Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.463239Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.469673Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.469798Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.470024Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.470052Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.470335Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.470357Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:44:04.006Z] "POST /v1/api-keys HTTP/2" 201 - via_upstream - "-" 55 320 21 - "100.64.0.2" "curl/7.76.1" "6d2d925d-535b-4b75-9a0c-d4d3bc5615e4" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:37880 10.132.0.39:443 100.64.0.2:9950 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:44:04.076Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.2" "Go-http-client/1.1" "2d538423-9861-4417-978b-79d726af6edc" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:52636 10.132.0.39:443 100.64.0.2:34272 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2
[2026-04-23T01:44:04.069Z] "GET /v1/models HTTP/2" 200 - via_upstream - "-" 0 590 15 - "100.64.0.4" "curl/7.76.1" "ba934a79-79f2-4b60-bca2-78f68f8a371b" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:37880 10.132.0.39:443 100.64.0.4:2262 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1
[2026-04-23T01:44:04.128Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 502 10 - "100.64.0.2" "curl/7.76.1" "8f7fe7c2-a113-4b3c-885e-698ff7c3e217" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:59986 10.132.0.39:443 100.64.0.2:28014 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.170Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 381 9 - "100.64.0.3" "curl/7.76.1" "25669183-1cf2-4780-b06f-a9ee191d8e7f" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:52636 10.132.0.39:443 100.64.0.3:60212 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.201Z] "POST /v1/chat/completions HTTP/2" 200 - via_upstream - "-" 100 530 9 - "100.64.0.4" "curl/7.76.1" "e8793584-5a35-4e8f-965d-81ea3293d6d2" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:59986 10.132.0.39:443 100.64.0.4:2268 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.236Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.2" "curl/7.76.1" "24b8a6f8-d1fb-4590-94fd-afba203f8a34" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:59986 10.132.0.39:443 100.64.0.2:28024 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.267Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 10 - "100.64.0.3" "curl/7.76.1" "ff1a91f2-5f72-47bc-9f04-d22950656ae3" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:52636 10.132.0.39:443 100.64.0.3:45136 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.302Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.3" "curl/7.76.1" "6d46bd4a-e42f-41e5-95e2-2e9f81cfe59a" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.39:443 100.64.0.3:18926 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.335Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "26da9d2a-be0d-4782-8076-1a1fc4a7697c" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:37606 10.132.0.39:443 100.64.0.4:64148 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.373Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.2" "curl/7.76.1" "424d8179-18ce-4932-ab57-f339b4fe7fe9" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.39:443 100.64.0.2:9966 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.402Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.3" "curl/7.76.1" "973017d3-ee50-4191-abbc-5c208a5e5b75" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.39:443 100.64.0.3:45142 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.432Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 8 - "100.64.0.4" "curl/7.76.1" "b33d9f32-426c-4698-be6c-6a7ac0770f0c" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.39:37630 10.132.0.39:443 100.64.0.4:30514 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.462Z] "POST /v1/chat/completions HTTP/2" 429 -  - "-" 100 18 7 - "100.64.0.4" "curl/7.76.1" "0678aea5-1fdc-4a9b-9b9d-a92eb313290d" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.39:443 100.64.0.4:64164 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
2026-04-23T01:44:04.516490Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.516526Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.517701Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.517735Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.540190Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.540225Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.545413Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.545515Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.548570Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.548640Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
2026-04-23T01:44:04.548680Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens	thread=18
2026-04-23T01:44:04.548689Z	warning	envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140	wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span	thread=18
[2026-04-23T01:44:04.515Z] "POST /llm/facebook-opt-125m-simulated/v1/chat/completions HTTP/2" 401 -  - "-" 100 0 1 - "100.64.0.2" "curl/7.76.1" "09663dcb-88d6-4488-9867-2fad3479e5f5" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.39:443 100.64.0.2:31972 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.1
[2026-04-23T01:44:04.539Z] "DELETE /v1/api-keys/7b38bdb2-dd1d-4080-8df6-32999153cc05 HTTP/2" 200 - via_upstream - "-" 0 334 9 - "100.64.0.3" "curl/7.76.1" "20b1ee87-1838-4f0f-8ddd-36e72486c2e2" "maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com" "10.133.0.36:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.132.0.39:37880 10.132.0.39:443 100.64.0.3:18940 maas.apps.d6fe55b0-9ce0-48f1-985a-07c04399c2e0.prod.konfluxeaas.com opendatahub.maas-api-route.1