2026-11-03T17:05:22.215585Z info FLAG: --concurrency="0" 2026-11-03T17:05:22.215605Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T17:05:22.215609Z info FLAG: --help="false" 2026-11-03T17:05:22.215611Z info FLAG: --log_as_json="false" 2026-11-03T17:05:22.215613Z info FLAG: --log_caller="" 2026-11-03T17:05:22.215615Z info FLAG: --log_output_level="default:info" 2026-11-03T17:05:22.215617Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T17:05:22.215621Z info FLAG: --log_target="[stdout]" 2026-11-03T17:05:22.215624Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T17:05:22.215626Z info FLAG: --outlierLogPath="" 2026-11-03T17:05:22.215628Z info FLAG: --profiling="true" 2026-11-03T17:05:22.215631Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T17:05:22.215632Z info FLAG: --proxyLogLevel="warning" 2026-11-03T17:05:22.215635Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T17:05:22.215637Z info FLAG: --stsPort="0" 2026-11-03T17:05:22.215639Z info FLAG: --templateFile="" 2026-11-03T17:05:22.215641Z info FLAG: --tokenManagerPlugin="" 2026-11-03T17:05:22.215643Z info FLAG: --vklog="0" 2026-11-03T17:05:22.215646Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T17:05:22.215798Z info Proxy role ips=[10.134.1.0] type=router id=maas-default-gateway-openshift-default-5bc884dd87-w8lvg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T17:05:22.215846Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T17:05:22.217001Z info cpu limit detected as 2, setting concurrency 2026-11-03T17:05:22.217231Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T17:05:22.217241Z info JWT policy is third-party-jwt 2026-11-03T17:05:22.217244Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T17:05:22.218696Z info Starting default Istio SDS Server 2026-11-03T17:05:22.218719Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T17:05:22.218761Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T17:05:22.219181Z info Opening status port 15020 2026-11-03T17:05:22.219910Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T17:05:22.220783Z info sds Starting SDS grpc server 2026-11-03T17:05:22.220817Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T17:05:22.221606Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T17:05:22.222509Z info Starting proxy agent 2026-11-03T17:05:22.222539Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T17:05:22.288489Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T17:05:22.302142Z info cache generated new workload certificate resourceName=default latency=81.12053ms ttl=23h59m59.697861451s 2026-11-03T17:05:22.302177Z info cache Root cert has changed, start rotating root cert 2026-11-03T17:05:22.302229Z info cache returned workload trust anchor from cache ttl=23h59m59.697771209s 2026-11-03T17:05:22.448968Z info ads ADS: new connection for node:1 2026-11-03T17:05:22.449093Z info cache returned workload certificate from cache ttl=23h59m59.550909651s 2026-11-03T17:05:22.449286Z info ads ADS: new connection for node:2 2026-11-03T17:05:22.449358Z info cache returned workload trust anchor from cache ttl=23h59m59.550643318s 2026-11-03T17:05:22.531638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:05:30.324488Z info Readiness succeeded in 8.111552684s 2026-11-03T17:05:30.324804Z info Envoy proxy is ready 2026-11-03T17:05:35.452397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:05:55.770715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:06:13.035281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:06:33.881Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 87 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "ab0e757c-3436-47c5-b690-3045ddf9c74f" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.0:40050 10.134.1.0:443 10.132.0.11:55548 - v1-completions-path 2026-11-03T17:06:55.015816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:07:05.884430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:07:12.391904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:07:40.553622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:07:45.177350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:08:08.726091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:08:15.019142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:08:41.049997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:09:03.118780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:09:16.163828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:09:21.818703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:09:46.765873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:09:52.242035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:10:01.643974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:10:01.644013Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:10:01.644027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:10:01.644032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:10:01.525Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 89 332 119 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "3cd9e37d-fb9d-4c87-a735-769c92cb06e5" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.0:52062 10.134.1.0:443 10.132.0.11:34136 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:10:12.175643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T17:10:21.490Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 65 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "ccdddb54-6729-4798-91a7-6153380e7653" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.0:40050 10.134.1.0:443 10.132.0.11:39542 - v1-completions-path 2026-11-03T17:10:35.254298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:10:46.062005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:11:06.798933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:11:12.592779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:14:09.503480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:14:15.297670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:15:42.480950Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T17:15:42.480980Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T17:15:42.480983Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T17:15:42.480987Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T17:15:42.429Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 51 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "8fb5d61b-ad29-4618-99aa-c698c8f55255" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.0:443 10.132.0.11:50394 - v1-completions-path 2026-11-03T17:16:03.565780Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:16:05.989638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T17:16:05.970Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 286 141 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "9ab1cb56-cdc4-488b-8d4c-df55f66479e7" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.0:48432 10.134.1.0:443 10.132.0.11:41150 - v1-completions-path 2026-11-03T17:16:20.693003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:16:25.081996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:16:49.983249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:18:37.202760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:18:37.202802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:18:37.202816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:18:37.202821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:18:37.145Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 57 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "4934e324-f50b-47f4-9074-779e89a1bc7d" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.0:48442 10.134.1.0:443 10.132.0.11:46768 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:18:44.801598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:19:28.422016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:19:59.192378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:20:14.107704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:20:17.314688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:20:17.314722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T17:20:17.314734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T17:20:17.314738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T17:20:17.253Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 61 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "3878e442-ea28-4a71-945e-259dc79c4e29" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.0:41014 10.134.1.0:443 10.132.0.11:39802 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:20:20.799093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:20:32.502883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:20:43.647687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:21:09.096147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:24:57.645341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:25:08.683129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:25:15.395772Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T17:25:15.310Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "3b0acd69-3894-4cfd-ad01-e5ceef92ba64" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.0:60724 10.134.1.0:443 10.132.0.11:39738 - v1-catch-all-path 2026-11-03T17:25:29.750844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:25:34.328336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:25:50.689720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T17:26:02.564193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8