2026-07-29T17:44:25.356027Z info FLAG: --concurrency="0" 2026-07-29T17:44:25.356045Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-07-29T17:44:25.356050Z info FLAG: --help="false" 2026-07-29T17:44:25.356052Z info FLAG: --log_as_json="false" 2026-07-29T17:44:25.356054Z info FLAG: --log_caller="" 2026-07-29T17:44:25.356056Z info FLAG: --log_output_level="default:info" 2026-07-29T17:44:25.356058Z info FLAG: --log_stacktrace_level="default:none" 2026-07-29T17:44:25.356063Z info FLAG: --log_target="[stdout]" 2026-07-29T17:44:25.356066Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-07-29T17:44:25.356068Z info FLAG: --outlierLogPath="" 2026-07-29T17:44:25.356070Z info FLAG: --profiling="true" 2026-07-29T17:44:25.356072Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-07-29T17:44:25.356074Z info FLAG: --proxyLogLevel="warning" 2026-07-29T17:44:25.356077Z info FLAG: --serviceCluster="istio-proxy" 2026-07-29T17:44:25.356079Z info FLAG: --stsPort="0" 2026-07-29T17:44:25.356081Z info FLAG: --templateFile="" 2026-07-29T17:44:25.356083Z info FLAG: --tokenManagerPlugin="" 2026-07-29T17:44:25.356085Z info FLAG: --vklog="0" 2026-07-29T17:44:25.356088Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-07-29T17:44:25.356238Z info Proxy role ips=[10.133.0.26] type=router id=maas-default-gateway-openshift-default-78bb78ff78-52cm4.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-07-29T17:44:25.356292Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-07-29T17:44:25.357448Z info cpu limit detected as 2, setting concurrency 2026-07-29T17:44:25.357661Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-07-29T17:44:25.357673Z info JWT policy is third-party-jwt 2026-07-29T17:44:25.357676Z info using credential fetcher of JWT type in cluster.local trust domain 2026-07-29T17:44:25.360068Z info Starting default Istio SDS Server 2026-07-29T17:44:25.360090Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-07-29T17:44:25.360110Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-07-29T17:44:25.360278Z info Opening status port 15020 2026-07-29T17:44:25.360898Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-07-29T17:44:25.362261Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-07-29T17:44:25.363192Z info Starting proxy agent 2026-07-29T17:44:25.363229Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-07-29T17:44:25.370997Z info sds Starting SDS grpc server 2026-07-29T17:44:25.371024Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-07-29T17:44:25.386276Z info cache generated new workload certificate resourceName=default latency=25.176443ms ttl=23h59m59.613728072s 2026-07-29T17:44:25.386314Z info cache Root cert has changed, start rotating root cert 2026-07-29T17:44:25.386354Z info cache returned workload trust anchor from cache ttl=23h59m59.613646659s 2026-07-29T17:44:25.422781Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-07-29T17:44:25.423127Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-07-29T17:44:25.428752Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-07-29T17:44:25.513968Z info ads ADS: new connection for node:1 2026-07-29T17:44:25.514576Z info cache returned workload certificate from cache ttl=23h59m59.485426198s 2026-07-29T17:44:25.514591Z info ads ADS: new connection for node:2 2026-07-29T17:44:25.514754Z info cache returned workload trust anchor from cache ttl=23h59m59.485248029s 2026-07-29T17:44:25.560090Z info wasm fetching image kuadrant/wasm-shim from registry quay.io with tag v0.12.1 2026-07-29T17:44:30.409970Z info Readiness succeeded in 5.056203167s 2026-07-29T17:44:30.410251Z info Envoy proxy is ready 2026-07-29T17:44:36.651641Z info ads ADS: new connection for node:3 2026-07-29T17:44:36.651842Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-07-29T17:44:36.651871Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-07-29T17:47:03.909983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 [2026-07-29T17:47:03.881Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 28 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "e0d79aa4-4e9a-4cc2-bace-0f21a8636459" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53862 10.133.0.26:443 10.132.0.8:59486 - odh-ai-gateway-infra.maas-api-route.3 2026-07-29T17:47:04.007293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 [2026-07-29T17:47:03.967Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 40 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "430a2d87-6696-408e-bc6b-511c3af26b7e" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53864 10.133.0.26:443 10.132.0.8:59490 - odh-ai-gateway-infra.maas-api-route.3 [2026-07-29T17:47:04.061Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 32 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "7becb300-a668-4715-b86c-eb5faa3a3550" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59506 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.131Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 13 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "ed128329-3928-44e7-bd0d-3919086835da" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59514 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-07-29T17:47:04.576531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 [2026-07-29T17:47:04.175Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 13 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "b1b9aaa8-1f8c-4b4e-9515-8f33bb3be10d" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59526 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.215Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 14 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "187971bf-770b-48f2-9d64-6f6783c9fb93" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59528 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.260Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "8db245de-7e1c-43d1-8b80-9f0c3a3a8f39" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59534 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.295Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "b0e10b90-e035-4c4c-bdc7-e1944a70260f" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59542 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.335Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "4252f338-7a4c-48f2-8c3b-829727d05b23" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59558 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.376Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 11 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "64127fb3-9adb-4fa9-b767-61a8fbe5523d" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59560 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.420Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 14 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "55ceba82-4667-43a8-b13a-ce016226b765" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59566 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.458Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 11 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "cf0d729b-ccd9-42dd-9746-61cb6f1b4f9f" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59572 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.495Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 13 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "13b28008-1647-4330-ab24-ab2acd5f8ba1" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59588 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.532Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 3 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "c1e3434b-8351-477c-b707-a931dc799f70" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:59590 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:04.562Z] "DELETE /v1/api-keys/50463993-1a2b-41f5-80ec-cc66490e9e2c HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "427a149e-5dcd-4bf7-afb0-4ec5324c1650" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53864 10.133.0.26:443 10.132.0.8:59594 - odh-ai-gateway-infra.maas-api-route.3 2026-07-29T17:47:37.297337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-29T17:47:37.354955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=25 2026-07-29T17:47:37.654318Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.654368Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.654875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.654908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.655130Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.691207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.691256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.700945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.701114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.701426Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.701471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.702011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.702052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.702281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.731642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.731695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.741139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.741307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.741615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.741659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.742172Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.742212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.742436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.768606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.768658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.777817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.777990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.778290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.778334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.778829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.778870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.779089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.804635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.804686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.813884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.814057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.814359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.814401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.814853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.814893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.815118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=25 2026-07-29T17:47:37.841863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.841901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.868238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.868284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.876243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.876435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.878674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.878756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 2026-07-29T17:47:37.878796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Missing json property: /usage/total_tokens thread=26 2026-07-29T17:47:37.878805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log openshift-ingress.kuadrant-maas-default-gateway: Span buffer full (100), dropping oldest span thread=26 [2026-07-29T17:47:37.281Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 15 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "9dcbcb86-2668-4431-8e24-ce54561a117b" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53864 10.133.0.26:443 10.132.0.8:57796 - odh-ai-gateway-infra.maas-api-route.3 [2026-07-29T17:47:37.346Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 8 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "fde41d97-c576-4f9f-ac68-2847be270438" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53862 10.133.0.26:443 10.132.0.8:57802 - odh-ai-gateway-infra.maas-api-route.3 [2026-07-29T17:47:37.406Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 14 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "3b347630-4955-418f-9555-f1a10fd5d3cf" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57812 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.457Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 11 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "e940dd96-9ea9-4dad-97b2-16a1dddc6253" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57824 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.492Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "fd2f82fd-6cbb-4afc-a6ae-38b5618a66c8" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57840 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.528Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "895e4b28-eff1-4591-b0a9-24246f5b8a6a" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57846 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.568Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 11 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "3cefa143-610c-4d52-88d0-e28e3a29981a" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57856 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.606Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "d6f33978-ecdf-410b-acc2-fc1fa49e9ea8" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57858 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.642Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "f18ed505-437c-4611-ba56-dd9e077484e5" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57870 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.689Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "fdc5e445-4835-4134-a540-5cd3bf4980a7" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57876 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.729Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "af572cc9-1e71-4bf3-a7e9-69537ac2129d" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57880 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.766Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "03eb1bc3-a095-4a04-8000-94eee197465e" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57894 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.802Z] "POST /v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{no_healthy_upstream{no_healthy_upstream}} - "-" 122 0 12 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "cca8274b-d05a-48f0-9864-859499a3685c" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57898 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.838Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 3 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "df10f5fe-806c-453a-881c-ddcebdd0164b" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.26:443 10.132.0.8:57914 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-07-29T17:47:37.866Z] "DELETE /v1/api-keys/1d2b5562-b4b9-4b44-bcf4-df356ac78cb7 HTTP/1.1" 200 - via_upstream - "-" 0 365 11 - "34.228.250.194,10.132.0.8" "curl/7.76.1" "8c47a2b6-523f-444b-bed9-018bf782eba9" "maas.apps.5769280a-8b04-4458-b5f6-dec240eef241.prod.konfluxeaas.com" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.26:53864 10.133.0.26:443 10.132.0.8:57916 - odh-ai-gateway-infra.maas-api-route.3