2026-11-03T17:06:07.579771Z info FLAG: --concurrency="0" 2026-11-03T17:06:07.579791Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T17:06:07.579795Z info FLAG: --help="false" 2026-11-03T17:06:07.579797Z info FLAG: --log_as_json="false" 2026-11-03T17:06:07.579799Z info FLAG: --log_caller="" 2026-11-03T17:06:07.579801Z info FLAG: --log_output_level="default:info" 2026-11-03T17:06:07.579803Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T17:06:07.579807Z info FLAG: --log_target="[stdout]" 2026-11-03T17:06:07.579810Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T17:06:07.579812Z info FLAG: --outlierLogPath="" 2026-11-03T17:06:07.579814Z info FLAG: --profiling="true" 2026-11-03T17:06:07.579816Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T17:06:07.579818Z info FLAG: --proxyLogLevel="warning" 2026-11-03T17:06:07.579820Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T17:06:07.579822Z info FLAG: --stsPort="0" 2026-11-03T17:06:07.579824Z info FLAG: --templateFile="" 2026-11-03T17:06:07.579826Z info FLAG: --tokenManagerPlugin="" 2026-11-03T17:06:07.579829Z info FLAG: --vklog="0" 2026-11-03T17:06:07.579831Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T17:06:07.579976Z info Proxy role ips=[10.133.0.150] type=router id=maas-default-gateway-openshift-default-5bc884dd87-rj7rb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T17:06:07.580023Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T17:06:07.581379Z info cpu limit detected as 2, setting concurrency 2026-11-03T17:06:07.581843Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T17:06:07.581867Z info JWT policy is third-party-jwt 2026-11-03T17:06:07.581872Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T17:06:07.583888Z info Starting default Istio SDS Server 2026-11-03T17:06:07.583909Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T17:06:07.583883Z info Opening status port 15020 2026-11-03T17:06:07.583930Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T17:06:07.584619Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T17:06:07.586393Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T17:06:07.587151Z info Starting proxy agent 2026-11-03T17:06:07.587183Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T17:06:07.595527Z info sds Starting SDS grpc server 2026-11-03T17:06:07.595552Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T17:06:07.651985Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T17:06:07.735614Z info cache generated new workload certificate resourceName=default latency=150.755354ms ttl=23h59m59.264391041s 2026-11-03T17:06:07.735649Z info cache Root cert has changed, start rotating root cert 2026-11-03T17:06:07.735706Z info cache returned workload trust anchor from cache ttl=23h59m59.264294941s 2026-11-03T17:06:07.808532Z info ads ADS: new connection for node:1 2026-11-03T17:06:07.808600Z info cache returned workload certificate from cache ttl=23h59m59.191402315s 2026-11-03T17:06:07.808671Z info ads ADS: new connection for node:2 2026-11-03T17:06:07.808792Z info cache returned workload trust anchor from cache ttl=23h59m59.191209363s 2026-11-03T17:06:07.892978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:06:12.697987Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-03T17:06:16.489458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:06:17.433118Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T17:06:18.074877Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T17:06:18.508490Z info Readiness succeeded in 10.931139856s 2026-11-03T17:06:18.508844Z info Envoy proxy is ready [2026-11-03T17:06:35.429Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 87 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "a18edcb2-da5e-4b62-8bc4-789e52cf7971" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.150:43558 10.133.0.150:443 10.132.0.11:43852 - v1-completions-path [2026-11-03T17:06:35.713Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 66 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "2d7c05ab-3242-40bc-bbfb-24604ebd5f4a" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.150:43570 10.133.0.150:443 10.132.0.11:43866 - v1-completions-path [2026-11-03T17:06:36.729Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "e4543adb-429b-4652-861c-dbd510565e70" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.150:43558 10.133.0.150:443 10.132.0.11:43868 - v1-completions-path 2026-11-03T17:06:55.050592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:07:05.911404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:07:12.399298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:07:22.844820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:07:22.844861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:07:22.844881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T17:07:22.844888Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T17:07:22.725Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 119 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "d817352b-7984-4b6f-a33f-480def1beb6d" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.133.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.150:48086 10.133.0.150:443 10.132.0.11:42084 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T17:07:26.215140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T17:07:26.207Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "c5578839-3b50-49b3-9d52-a1bcc6974bef" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.150:43558 10.133.0.150:443 10.132.0.11:39240 - v1-completions-path 2026-11-03T17:07:40.567994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:07:45.214644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:08:08.729463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:08:15.043573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:08:41.042295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:09:03.164899Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:09:16.181892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:09:21.862772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:09:46.808264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:09:52.259383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T17:10:01.849Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 83 - "52.71.36.72,10.132.0.11" "python-requests/2.34.2" "1c6ee97f-bd93-4f69-93ff-9b5353851e17" "maas.apps.9cece269de92f9b7187a.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.150:51544 10.133.0.150:443 10.132.0.11:48402 - v1-completions-path 2026-11-03T17:10:12.216941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:10:35.258169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:10:46.087444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:11:06.815319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:11:12.622284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:14:09.539551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:14:15.349233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:16:03.575437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:16:20.732007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:16:25.092692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:16:49.991324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:18:44.833431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:19:28.422749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:19:59.203698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:20:14.131658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:20:20.815610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:20:32.529524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:20:43.651577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:21:09.107451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:24:57.663102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:25:08.679881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:25:29.776755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:25:34.332836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:25:50.687820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T17:26:02.609921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9