2026-10-30T18:13:06.176237Z info FLAG: --concurrency="0" 2026-10-30T18:13:06.176263Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T18:13:06.176269Z info FLAG: --help="false" 2026-10-30T18:13:06.176273Z info FLAG: --log_as_json="false" 2026-10-30T18:13:06.176276Z info FLAG: --log_caller="" 2026-10-30T18:13:06.176279Z info FLAG: --log_output_level="default:info" 2026-10-30T18:13:06.176283Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T18:13:06.176290Z info FLAG: --log_target="[stdout]" 2026-10-30T18:13:06.176295Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T18:13:06.176298Z info FLAG: --outlierLogPath="" 2026-10-30T18:13:06.176301Z info FLAG: --profiling="true" 2026-10-30T18:13:06.176305Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T18:13:06.176308Z info FLAG: --proxyLogLevel="warning" 2026-10-30T18:13:06.176311Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T18:13:06.176315Z info FLAG: --stsPort="0" 2026-10-30T18:13:06.176318Z info FLAG: --templateFile="" 2026-10-30T18:13:06.176321Z info FLAG: --tokenManagerPlugin="" 2026-10-30T18:13:06.176326Z info FLAG: --vklog="0" 2026-10-30T18:13:06.176330Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T18:13:06.176507Z info Proxy role ips=[10.133.1.134] type=router id=maas-default-gateway-openshift-default-7df854bf67-j4pdf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T18:13:06.176567Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T18:13:06.178271Z info cpu limit detected as 2, setting concurrency 2026-10-30T18:13:06.178589Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T18:13:06.178604Z info JWT policy is third-party-jwt 2026-10-30T18:13:06.178616Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T18:13:06.181387Z info Starting default Istio SDS Server 2026-10-30T18:13:06.181428Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T18:13:06.181459Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T18:13:06.181613Z info Opening status port 15020 2026-10-30T18:13:06.182404Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T18:13:06.184345Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T18:13:06.185482Z info Starting proxy agent 2026-10-30T18:13:06.185527Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T18:13:06.198847Z info sds Starting SDS grpc server 2026-10-30T18:13:06.198876Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T18:13:06.251371Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T18:13:06.368792Z info ads ADS: new connection for node:1 2026-10-30T18:13:06.369264Z info ads ADS: new connection for node:2 2026-10-30T18:13:06.407476Z info cache generated new workload certificate resourceName=default latency=224.938769ms ttl=23h59m59.592530802s 2026-10-30T18:13:06.407524Z info cache Root cert has changed, start rotating root cert 2026-10-30T18:13:06.407575Z info cache returned workload trust anchor from cache ttl=23h59m59.592426027s 2026-10-30T18:13:06.407597Z info cache returned workload certificate from cache ttl=23h59m59.59240404s 2026-10-30T18:13:06.407694Z info cache returned workload trust anchor from cache ttl=23h59m59.592310294s 2026-10-30T18:13:06.408128Z info cache returned workload trust anchor from cache ttl=23h59m59.591873182s 2026-10-30T18:13:06.509350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:13:14.631406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:13:15.512902Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T18:13:15.766370Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T18:13:17.089169Z info Readiness succeeded in 10.916555743s 2026-10-30T18:13:17.089549Z info Envoy proxy is ready 2026-10-30T18:13:24.037928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:13:29.276Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 82 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "09d9c594-de94-4137-ae04-210a9b2d6853" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.134:48088 10.133.1.134:443 10.132.0.21:52432 - v1-completions-path 2026-10-30T18:13:41.533690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:13:44.019087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:13:47.202872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:13:56.977149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:14:14.516Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "d9066a86-158f-43f6-8881-bf68a68635e1" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.134:48088 10.133.1.134:443 10.132.0.21:54236 - v1-completions-path 2026-10-30T18:14:30.642525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:14:41.089678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:15:05.116753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:15:09.576Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "4e1c5dd8-f994-4659-9126-11662fc5af35" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.134:43598 10.133.1.134:443 10.132.0.21:37684 - v1-completions-path 2026-10-30T18:15:22.713569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:15:25.063781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:15:44.308959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:15:56.396131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:16:14.034785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:16:30.056322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T18:16:29.982Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 75 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "aabaeb49-3041-4aa7-915b-ee04a114758d" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.134:59238 10.133.1.134:443 10.132.0.21:36630 - v1-completions-path 2026-10-30T18:16:31.219794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:16:41.938443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:16:45.126047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:17:04.306245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:17:07.049056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:17:28.016595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:17:30.721574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:19:10.256395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:19:13.765741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:20:43.594895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:20:59.221498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:21:01.422269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:21:04.284027Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T18:21:04.284157Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T18:21:04.284190Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T18:21:04.284214Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T18:21:04.194Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 90 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "3c7186ce-d189-4702-9ee3-cbb27284b160" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.134:443 10.132.0.21:40814 - v1-completions-path 2026-10-30T18:21:26.121203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:23:08.860855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:23:08.860894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:23:08.860913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:23:08.860918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:23:08.790Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 70 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "1398b937-801d-4829-aff7-ce6c57ccb432" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.134:45124 10.133.1.134:443 10.132.0.21:40836 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:23:23.942621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:23:45.238025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:24:11.606538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:24:23.469489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:24:27.722715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:24:39.387925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:24:52.835995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:25:17.980Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "4a61aad0-d7a3-418e-91d9-768c9c1b9390" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.134:443 10.132.0.21:59500 - v1-completions-path 2026-10-30T18:25:29.997349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:25:39.941711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:25:48.317485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:26:01.602672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:26:03.942197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:26:12.438521Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T18:26:12.364Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "99ac0d95-d329-4e32-b8fe-e2446381def4" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.134:55882 10.133.1.134:443 10.132.0.21:41798 - v1-catch-all-path 2026-10-30T18:26:24.393249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:26:35.341485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9