2026-04-19T13:01:37.465966Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:01:37.466099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:01:37.468186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.468232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.476890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.477032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.477670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.477727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.477769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:37.477783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.479733Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.479774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.487908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.488015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.488414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.488453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.488482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:37.488491Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.490292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.490320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.499270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.499375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.499935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.499974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.500004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:37.500013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:37.500904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:01:37.500953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:01:37.500999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:01:37.501010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:01:37.467Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 10 - "100.64.0.4" "Go-http-client/1.1" "46cf8a46-d634-4384-8bb5-61ba77c7cf66" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43396 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-19T13:01:37.479Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.4" "Go-http-client/1.1" "f6c4d120-d88c-4cff-8d88-b515de0f2191" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:56322 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-19T13:01:37.489Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "100.64.0.4" "Go-http-client/1.1" "ab9b31ff-cbc7-4230-9e8e-8552fe85a216" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:48874 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:01:37.459Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1222 41 - "100.64.0.2" "python-requests/2.32.5" "ab32da25-8b5c-44eb-91a4-5c7ccc0cfcde" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:51908 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:01:54.924643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.924690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.929974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.930086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.932618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.932650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.932665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.941230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.941337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.941410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.941978Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.941999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.942033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.942045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.942075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:54.942084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.942095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:54.942100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.943528Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.943567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:01:54.943596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:01:54.943604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:01:54.931Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 10 - "100.64.0.4" "Go-http-client/1.1" "330acc40-970a-4d85-8f6e-d3b2a5b79571" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:48874 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:01:54.923Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 477 20 - "100.64.0.3" "python-requests/2.32.5" "161f1e7d-9287-458e-9b9c-c4b8cb3dde9e" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.3:49986 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:06.033564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.033613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.040197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.040310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.040458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.044143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.044191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:06.044222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:02:06.044229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:02:06.032Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 11 - "100.64.0.2" "python-requests/2.32.5" "d2739d3a-b5d3-4063-87a3-5083b6aebb03" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:30960 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:14.074474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.074525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.078220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.078328Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.079880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.079912Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.080953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.080982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.081919Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.081960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:14.081990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:14.081999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:02:14.079Z] "GET /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/models HTTP/1.1" 403 - - "-" 0 0 1 - "100.64.0.4" "Go-http-client/1.1" "24a24001-e009-4b3c-94b4-0d444e907ec0" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:02:14.073Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 8 - "100.64.0.4" "python-requests/2.32.5" "ada8b739-752f-4435-91ea-df9bd68914a6" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.4:43742 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:14.626890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.626944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.632467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.632611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.632790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.634930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.634990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:14.635036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:02:14.635049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:02:14.625Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 31 315 9 - "100.64.0.3" "python-requests/2.32.5" "370fb5ca-ae65-4cf2-ab34-f04a7d33f5d9" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:62902 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:22.666221Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.666271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.669976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.670106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.671969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.672002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.678302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.678449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.678549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.679908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.679964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.679997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:22.680006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.680992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.681034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:22.681067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:22.681076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.014503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.014564Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.020134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.020274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.020452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.022552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.022618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:23.022658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:23.022668Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:02:22.671Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.4" "Go-http-client/1.1" "ab6650a1-f78b-43cd-ae3f-14dde07f1f3c" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:48874 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:02:22.665Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 16 - "100.64.0.4" "python-requests/2.32.5" "4e382a74-3864-420d-bad8-01e767cd5ce9" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.4:57694 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:02:23.013Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 317 9 - "100.64.0.2" "python-requests/2.32.5" "e01b7022-6a30-43f4-bba3-0b067b554890" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.2:39752 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:31.059546Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.059596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.063499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.063608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.065361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.065393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.071185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.071320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.071412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.071972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.072017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.072049Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:31.072058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.073066Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.073116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:31.073150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:31.073159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:02:31.064Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 7 - "100.64.0.4" "Go-http-client/1.1" "82f1665d-e8a0-46b5-95e9-1fed4af79b9c" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:48874 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:02:31.058Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 590 14 - "100.64.0.4" "python-requests/2.32.5" "f9e89701-62b2-4489-b1ce-600e7cdd3fc9" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.4:61526 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:31.733560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.733617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.739409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.739541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.739712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.741774Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.741833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:31.741908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:02:31.741923Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:02:31.732Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 9 - "100.64.0.3" "python-requests/2.32.5" "dc73181d-63e3-4476-9e1a-4ad29eacb186" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:46562 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:39.772716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.772776Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.776741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.776898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.778702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.778738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.778753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.785083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.785216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.785331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.785414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786040Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:39.786128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.786139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:39.786144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.787129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.787169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:02:39.787203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:02:39.787211Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:02:39.777Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 8 - "100.64.0.4" "Go-http-client/1.1" "239b441e-c3cf-4e9c-82b5-34a0f5a1b405" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:48874 10.134.0.33:443 100.64.0.4:63546 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:02:39.771Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 474 15 - "100.64.0.3" "python-requests/2.32.5" "03adef87-5dd4-45a6-9bb7-163f151c14c0" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.3:34430 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:02:48.858834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.858906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.865413Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.865534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.865687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.867840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.867910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:02:48.867944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:02:48.867953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:02:48.857Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 85 328 10 - "100.64.0.2" "python-requests/2.32.5" "78c4e949-2c15-4050-9fac-2cc8eb27d0d6" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:7310 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:03:05.121316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.121365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.125127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.125245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.125973Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.126020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:03:05.126052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:03:05.126061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:03:05.120Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 5 - "100.64.0.4" "python-requests/2.32.5" "410d7e5f-b4fa-4e19-9982-f017cfd8d557" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:58414 10.134.0.33:443 100.64.0.4:33438 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:03:22.119946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.120003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.125992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.126107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.126935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.126981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:22.127012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:03:22.127021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:03:22.118Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.3" "python-requests/2.32.5" "0dff0e8a-bdfa-476e-83b6-4e14c84b9ac3" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:62046 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:03:34.443Z] "GET / HTTP/1.1" 404 NR route_not_found - "-" 0 0 0 - "100.64.0.4" "Wget" "cfa6c276-e8c2-4d2f-a1e4-1b107b91a50b" "23.23.37.204" "-" - - 10.134.0.33:80 100.64.0.4:64548 - - 2026-04-19T13:03:39.239435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.239485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.245006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.245126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.245952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.246000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:39.246030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:03:39.246039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:03:39.238Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 82 7 - "100.64.0.2" "python-requests/2.32.5" "783e1db9-ca88-4176-a5e1-52d57076167b" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:19978 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:03:56.557069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.557117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.563292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.563415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.564270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.564322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:03:56.564354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:03:56.564363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:03:56.555Z] "GET /v1/models HTTP/1.1" 403 - via_upstream - "-" 0 89 8 - "100.64.0.4" "python-requests/2.32.5" "0abf5f30-7f36-4cdb-9782-f87e3ed9034a" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.4:60766 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:04:10.472554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.472613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.479318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.479497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.479717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.482307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.482364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:10.482394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:10.482404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:04:10.471Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 45 329 11 - "100.64.0.3" "python-requests/2.32.5" "3200e22c-840e-4887-bbcd-a8e140b856bd" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:53154 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:04:18.513246Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.513294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.527637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.527753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.539322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.539360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.545517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.545644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.545736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.546327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.546373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.546406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:18.546415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.547315Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.547356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:18.547385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:18.547393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:04:18.538Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 7 - "100.64.0.4" "Go-http-client/1.1" "7a800557-8021-4aeb-9e2d-90f56181c639" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43380 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-19T13:04:18.512Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 342 35 - "100.64.0.2" "python-requests/2.32.5" "ee43accd-a009-47a4-bab8-200b7e861463" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:10604 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:04:30.530382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.530433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.535804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.535963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.536264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.541015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.541069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.541103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:04:30.541113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.562191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.562230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.567152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.567258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.567398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.569396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.569441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:30.569473Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:04:30.569483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:04:30.529Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 298 12 - "100.64.0.2" "python-requests/2.32.5" "d4e0d62c-8f76-4d17-84b9-981cfed8f596" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:51238 10.134.0.33:443 100.64.0.2:57704 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:04:30.561Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 297 8 - "100.64.0.3" "python-requests/2.32.5" "fa020b77-eca6-41a8-a652-ee31205566fd" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:51238 10.134.0.33:443 100.64.0.3:56240 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:04:38.596585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.596638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.600394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.600516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.602409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.602449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.608285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.608411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.608513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.609108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.609157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.609197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:38.609207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.610104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.610147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.610177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:38.610186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.637788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.637840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.641020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.641155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.642948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.642980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.648467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.648586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.648686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.650961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.651011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.651043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:38.651052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:38.652880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.652929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:38.652964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:04:38.652974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:04:38.601Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 7 - "100.64.0.4" "Go-http-client/1.1" "19977c52-9e82-4800-b45a-b014efc5189b" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43380 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-19T13:04:38.595Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 339 14 - "100.64.0.4" "python-requests/2.32.5" "1479fd13-6ffb-464a-bb81-3b3570752fbc" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.4:17324 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:04:38.642Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 8 - "100.64.0.4" "Go-http-client/1.1" "b065ffcb-124c-4f75-b334-3645561d4ade" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43434 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-19T13:04:38.636Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 345 16 - "100.64.0.2" "python-requests/2.32.5" "b2cadcb9-76b5-4905-9a48-83768a689429" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:51238 10.134.0.33:443 100.64.0.2:22216 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:04:55.005585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.005643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.011581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.011711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.014137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.014172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.027045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.027143Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.027746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.027797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.027839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:55.027873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.030392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.030423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.041226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.041348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.041761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.041807Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.041839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:55.041876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.043908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.043939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.052179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.052283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.055168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.055213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.055245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:04:55.055255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:04:55.056222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.056264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:04:55.056306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:04:55.056317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 [2026-04-19T13:04:55.013Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 14 - "100.64.0.4" "Go-http-client/1.1" "48378f55-14de-4670-9d32-269999a4f386" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43380 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-19T13:04:55.029Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 12 - "100.64.0.4" "Go-http-client/1.1" "30d83eac-ceb7-4453-bd37-39f65da9d16d" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43434 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-19T13:04:55.043Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 12 - "100.64.0.4" "Go-http-client/1.1" "facfd449-ece5-4fce-855e-d50ec390922b" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:41460 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:04:55.004Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 1232 51 - "100.64.0.4" "python-requests/2.32.5" "1d81be31-7cfa-4ee2-8d2a-fa96e1e4779c" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:51238 10.134.0.33:443 100.64.0.4:36438 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:05:11.390381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.390441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.395720Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.395867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.397785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.397823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.406046Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.406163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.406773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.406822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.406880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:11.406891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.407943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.407984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.408015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:11.408024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.427670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.427707Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.432166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.432264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.433916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.433946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.442241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.442353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.442717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.442759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.442789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:11.442797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.443723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.443761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:11.443791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:11.443800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:05:11.396Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 162 9 - "100.64.0.4" "Go-http-client/1.1" "d7cc9168-1bbc-4de9-a269-e99de8518359" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.33:8000" outbound|8000||e2e-distinct-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43380 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-simulated-kserve-route.2 [2026-04-19T13:05:11.389Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 341 18 - "100.64.0.3" "python-requests/2.32.5" "1f2c0ad0-d86c-9ee3-b142-2d3cbbf3cc5e" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:4698 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:05:11.433Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 166 9 - "100.64.0.4" "Go-http-client/1.1" "04bc838b-801e-4672-b719-8f2afba8a64b" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.37:8000" outbound|8000||e2e-distinct-2-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:43434 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-distinct-2-simulated-kserve-route.2 [2026-04-19T13:05:11.426Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 347 17 - "100.64.0.2" "python-requests/2.32.5" "6a179599-cadd-4e5e-b903-14fab25c374e" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.2:51888 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:05:20.429290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:20.429337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:20.430754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:20.430789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:05:20.428Z] "GET /maas-api/v1/models HTTP/1.1" 401 - - "-" 0 0 2 - "100.64.0.3" "python-requests/2.32.5" "3c8e2ac7-a83f-9240-8c24-7a9f1c75019f" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "-" outbound|8443||maas-api.opendatahub.svc.cluster.local - 10.134.0.33:443 100.64.0.3:57432 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:05:37.014834Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.014901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.020732Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.020863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.021010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.023938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.023993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.024036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=17 2026-04-19T13:05:37.024047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.039775Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.039810Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.047753Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.047894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.048126Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.048160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.049422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.049444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.049593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.050556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.050663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.050754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.050938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.051516Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.069085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.069121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.075524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.075700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.076073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.076114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.076711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.076744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.077144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.078641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.078819Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.079004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.079253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.079709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.095706Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.095742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.101602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.101717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.101962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.101991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.102543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.102568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.118667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.118700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.125026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.125154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.125390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.125422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.125977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.126001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:37.144253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.144288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.147547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.147646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.149987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.150016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.155871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.155983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.156071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.156389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.156427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.156459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:37.156467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.157942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.157979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:37.158007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:37.158016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:05:37.013Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 10 - "100.64.0.2" "python-requests/2.32.5" "a7c4c64b-08c8-4180-9bc8-a51db1489f29" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:51238 10.134.0.33:443 100.64.0.2:21424 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:05:37.039Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 12 - "100.64.0.4" "python-requests/2.32.5" "38500308-ea7f-4a8c-b733-c5ecb62304d5" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:42984 10.134.0.33:443 100.64.0.4:55414 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-19T13:05:37.068Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 11 - "100.64.0.3" "python-requests/2.32.5" "faf3533f-29d9-4ebb-acd5-f8cb7d6d8760" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:56190 10.134.0.33:443 100.64.0.3:10912 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-19T13:05:37.095Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.2" "python-requests/2.32.5" "f91587fa-f265-47bc-a888-3ba108a9cf86" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:42984 10.134.0.33:443 100.64.0.2:21428 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-19T13:05:37.118Z] "POST /v1/completions HTTP/1.1" 429 - - "-" 66 18 7 - "100.64.0.4" "python-requests/2.32.5" "6d5f21b3-56e9-4f0c-97f6-ab753ea126f9" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.33:443 100.64.0.4:55418 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-04-19T13:05:37.149Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 150 6 - "100.64.0.4" "Go-http-client/1.1" "b7524a11-14a1-43a8-b3e9-9bd5d457dc57" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.33:56190 10.134.0.33:443 100.64.0.4:41274 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.2 [2026-04-19T13:05:37.143Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 547 14 - "100.64.0.4" "python-requests/2.32.5" "07af42b0-77ae-4e24-9bd2-eb371828d06b" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.4:41680 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 2026-04-19T13:05:46.100618Z info ads ADS: new connection for node:6 2026-04-19T13:05:46.103047Z info cache read certificate from file resource=file-root:system 2026-04-19T13:05:52.695730Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.695781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.700991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.701117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.701271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.703603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.703650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:52.703683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:52.703692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.042360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.042407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.043618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.043651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.061431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.061465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.062466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.062494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=17 2026-04-19T13:05:53.113989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.114022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.120748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.120888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.121140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.121170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.122755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.122779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.123206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.136121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.136247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 2026-04-19T13:05:53.136342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=18 2026-04-19T13:05:53.136352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1140 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=18 [2026-04-19T13:05:52.694Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 9 - "100.64.0.3" "python-requests/2.32.5" "1a9445cd-11f5-4d26-8061-0b40075fad94" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "10.133.0.30:8443" outbound|8443||maas-api.opendatahub.svc.cluster.local 10.134.0.33:50714 10.134.0.33:443 100.64.0.3:10754 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com opendatahub.maas-api-route.1 [2026-04-19T13:05:53.041Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 2 - "100.64.0.2" "python-requests/2.32.5" "01238da3-50b4-4517-a257-ee839e6b2b5f" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.33:443 100.64.0.2:27336 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-04-19T13:05:53.060Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 1 - "100.64.0.4" "python-requests/2.32.5" "8ee510c9-929f-4545-9957-07171bb04f25" "maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com" "-" outbound|443||httpbin.org - 10.134.0.33:443 100.64.0.4:36918 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-external-model.0 [2026-04-19T13:05:53.113Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 233 23 - "100.64.0.3" "python-requests/2.32.5" "e7e3b5e2-399a-4b55-90de-f0081273f6bc" "httpbin.org" "52.6.193.180:443" outbound|443||httpbin.org 10.134.0.33:41406 10.134.0.33:443 100.64.0.3:25240 maas.apps.31b99498-0690-4f6b-bd43-f607f4662c4c.prod.konfluxeaas.com llm.e2e-external-model.0 2026-04-19T13:06:30.772393Z info ads ADS: "" 6 terminated with stream closed