2026-11-03T19:37:26.253599Z info FLAG: --concurrency="0" 2026-11-03T19:37:26.253617Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T19:37:26.253621Z info FLAG: --help="false" 2026-11-03T19:37:26.253624Z info FLAG: --log_as_json="false" 2026-11-03T19:37:26.253626Z info FLAG: --log_caller="" 2026-11-03T19:37:26.253628Z info FLAG: --log_output_level="default:info" 2026-11-03T19:37:26.253630Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T19:37:26.253635Z info FLAG: --log_target="[stdout]" 2026-11-03T19:37:26.253638Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T19:37:26.253640Z info FLAG: --outlierLogPath="" 2026-11-03T19:37:26.253642Z info FLAG: --profiling="true" 2026-11-03T19:37:26.253644Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T19:37:26.253646Z info FLAG: --proxyLogLevel="warning" 2026-11-03T19:37:26.253648Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T19:37:26.253650Z info FLAG: --stsPort="0" 2026-11-03T19:37:26.253651Z info FLAG: --templateFile="" 2026-11-03T19:37:26.253653Z info FLAG: --tokenManagerPlugin="" 2026-11-03T19:37:26.253656Z info FLAG: --vklog="0" 2026-11-03T19:37:26.253658Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T19:37:26.253796Z info Proxy role ips=[10.132.0.54] type=router id=maas-default-gateway-openshift-default-66db998887-qtcsx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T19:37:26.253868Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T19:37:26.254901Z info cpu limit detected as 2, setting concurrency 2026-11-03T19:37:26.255180Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T19:37:26.255192Z info JWT policy is third-party-jwt 2026-11-03T19:37:26.255194Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T19:37:26.256800Z info Starting default Istio SDS Server 2026-11-03T19:37:26.256825Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T19:37:26.256858Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T19:37:26.257291Z info Opening status port 15020 2026-11-03T19:37:26.258002Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T19:37:26.258689Z info sds Starting SDS grpc server 2026-11-03T19:37:26.258723Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T19:37:26.259319Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T19:37:26.260125Z info Starting proxy agent 2026-11-03T19:37:26.260157Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T19:37:26.324704Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T19:37:26.390862Z info cache generated new workload certificate resourceName=default latency=132.070813ms ttl=23h59m59.609141536s 2026-11-03T19:37:26.390898Z info cache Root cert has changed, start rotating root cert 2026-11-03T19:37:26.390928Z info cache returned workload trust anchor from cache ttl=23h59m59.60907302s 2026-11-03T19:37:26.428471Z info ads ADS: new connection for node:1 2026-11-03T19:37:26.428527Z info cache returned workload certificate from cache ttl=23h59m59.571475088s 2026-11-03T19:37:26.428659Z info ads ADS: new connection for node:2 2026-11-03T19:37:26.428738Z info cache returned workload trust anchor from cache ttl=23h59m59.571263516s 2026-11-03T19:37:26.510681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:37:34.355622Z info Readiness succeeded in 8.104269503s 2026-11-03T19:37:34.355943Z info Envoy proxy is ready [2026-11-03T19:37:39.190Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 68 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "176ebfa3-1183-451d-a628-3aba32185b1f" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.54:443 10.132.0.12:55960 - v1-model-routing 2026-11-03T19:37:39.339825Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T19:37:39.339850Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T19:37:39.339853Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T19:37:39.339857Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T19:37:39.322Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "52.71.36.72,10.132.0.12" "curl/7.76.1" "c558cfd3-d55c-4346-a142-7ae881199d42" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.54:443 10.132.0.12:55964 - v1-model-routing 2026-11-03T19:39:50.660759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:39:50.660798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:39:50.660822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:39:50.660829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:39:51.018690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:51.018726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:51.018743Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:51.018750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:39:50.551Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 109 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6d6bc0a1-6047-410c-b618-92bdfcf5b914" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:47890 10.132.0.54:443 10.132.0.12:59434 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:39:50.921Z] "DELETE /v1/api-keys/541cd3ef-3ee5-4073-88d0-a08c11d6da3e HTTP/1.1" 200 - via_upstream - "-" 0 370 97 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "01ed39e6-970d-4d78-a3a8-355497950e07" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:47898 10.132.0.54:443 10.132.0.12:59440 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:39:52.964123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:52.964151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:39:52.964163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:39:52.964167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:39:52.855Z] "DELETE /v1/api-keys/7d80a3bb-8296-473b-9cb8-5736716b8d5c HTTP/1.1" 200 - via_upstream - "-" 0 321 108 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c3fb8382-99e4-42c0-88de-22d3251da056" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:47898 10.132.0.54:443 10.132.0.12:59452 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:40:02.943Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 121 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2c39cbb8-7ea6-49f0-8444-82612f5620fb" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:59792 10.132.0.54:443 10.132.0.12:43750 - v1-completions-path 2026-11-03T19:40:12.974461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:40:29.129649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:43:14.600Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 10 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "09840e5a-42dd-4a0d-b924-b4474aaa0270" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.54:443 10.132.0.12:57720 - - 2026-11-03T19:43:34.420615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:43:34.420779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:43:34.420831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:43:34.420861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:43:34.264Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 156 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7400b1f1-01cb-40f1-9657-fa5cd23a127b" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:58860 10.132.0.54:443 10.132.0.12:32798 - odh-ai-gateway-infra.maas-api-route.4 2026-11-03T19:44:11.584225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:44:49.751174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:45:56.218327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:46:24.890198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:46:58.868384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:48:16.970116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:52.411473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:38.479261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:53:59.530753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:54:21.314348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:54:32.540654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:54:32.540685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:54:32.540695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:54:32.540700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:54:32.478Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "df12fd94-f1f0-43b9-8767-d21f50a4e46d" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:56342 10.132.0.54:443 10.132.0.12:53666 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:08.869814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:14.422651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:14.422683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:14.422694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:14.422699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:55:14.366Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 56 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c5344046-2e11-46ee-a6b7-f54663cba48d" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:56342 10.132.0.54:443 10.132.0.12:50510 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:55:15.185Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d2d60403-6d6f-4aed-9d2e-6a9a1e07e77b" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:54874 10.132.0.54:443 10.132.0.12:50526 - v1-completions-path 2026-11-03T19:55:27.236661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:28.976621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:46.169002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:55:45.556Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e2e3cf22-394f-4c58-830e-aea66810c832" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:59792 10.132.0.54:443 10.132.0.12:40206 - v1-completions-path 2026-11-03T19:55:48.142054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:50.858571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:59.130412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:05.174934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:56:05.174965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:56:05.174977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:56:05.174982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:56:05.476029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T19:56:05.119Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 55 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "a0e6668e-e3a4-4e49-b015-3c6ac295c23c" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:47582 10.132.0.54:443 10.132.0.12:53550 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T19:56:05.419Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "4338ee4c-c7da-420d-87ca-f523ca88997d" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:56278 10.132.0.54:443 10.132.0.12:53562 - v1-completions-path [2026-11-03T19:56:07.041Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "0b5ccf18-23ab-4088-b155-c9fd4447d146" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:56278 10.132.0.54:443 10.132.0.12:53574 - v1-completions-path 2026-11-03T19:56:24.048109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:34.203693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:36.004912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:41.368127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:56:41.368168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:56:41.368186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:56:41.368192Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:56:41.308Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 60 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3b28897b-7570-4f66-8069-517c9f66de53" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:34322 10.132.0.54:443 10.132.0.12:41382 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:56:55.298351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:56:56.976275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:01.551148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:57:01.551180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:57:01.551193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:57:01.551198Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:57:01.483Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 67 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "76a20a65-0fcb-4f24-bb38-552c7624907a" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:34322 10.132.0.54:443 10.132.0.12:51104 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:57:13.238605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:14.997862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:31.839008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:33.589423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:57:49.652037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:00.289690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:02.887939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T19:58:26.233Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 34 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "cfd5a23e-6e99-4edc-a8ee-df49c1983762" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.54:443 10.132.0.12:42874 - v1-completions-path 2026-11-03T19:58:28.755383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:35.069746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.069782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.069798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:58:35.069803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:58:35.005Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2dfb29b4-0cc6-42c8-a0fa-7d5a5486c660" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:60248 10.132.0.54:443 10.132.0.12:53136 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:58:47.102222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:58:57.285808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:01:54.905724Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:01:54.905749Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:01:54.905752Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:01:54.905757Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T20:01:54.861Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 43 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "dff023ed-ee41-4270-bb34-127dbf2fbf04" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.54:443 10.132.0.12:52440 - v1-completions-path 2026-11-03T20:02:15.920625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:31.418071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:33.317791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:02:38.407985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:38.408019Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:38.408031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:02:38.408037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:02:38.343Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "70ece292-0d53-4486-aa3f-3fcd2c444693" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:40796 10.132.0.54:443 10.132.0.12:48786 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:02:50.536179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:12.775536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:04:12.775572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:04:12.775587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:04:12.775592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:04:12.706Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 69 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2f5da456-950f-4ac1-960b-1d40c110a0ed" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:45700 10.132.0.54:443 10.132.0.12:44678 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:04:19.365879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:34.861738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:50.744283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:02.388338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:03.036114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:05:03.036148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:05:03.036162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:05:03.036167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:05:02.907Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 128 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "350dab0d-7f86-4851-936a-e824041f7cd3" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.54:44840 10.132.0.54:443 10.132.0.12:56442 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:05:06.572700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:14.774911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:17.458719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:35.238864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:18.816155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:25.191939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T20:08:25.259881Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T20:08:25.183Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 76 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6c54577f-8423-4de5-854a-c92b014618b8" "maas.apps.9321a750a8b0878027a2.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.54:58314 10.132.0.54:443 10.132.0.12:59922 - v1-catch-all-model-routing 2026-11-03T20:08:27.304068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:32.136456Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:08:42.765722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:44.412101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:59.155863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:10.050126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8