2026-11-03T18:16:02.761854Z info FLAG: --concurrency="0" 2026-11-03T18:16:02.761879Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T18:16:02.761886Z info FLAG: --help="false" 2026-11-03T18:16:02.761890Z info FLAG: --log_as_json="false" 2026-11-03T18:16:02.761893Z info FLAG: --log_caller="" 2026-11-03T18:16:02.761896Z info FLAG: --log_output_level="default:info" 2026-11-03T18:16:02.761899Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T18:16:02.761907Z info FLAG: --log_target="[stdout]" 2026-11-03T18:16:02.761912Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T18:16:02.761915Z info FLAG: --outlierLogPath="" 2026-11-03T18:16:02.761919Z info FLAG: --profiling="true" 2026-11-03T18:16:02.761923Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T18:16:02.761927Z info FLAG: --proxyLogLevel="warning" 2026-11-03T18:16:02.761931Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T18:16:02.761935Z info FLAG: --stsPort="0" 2026-11-03T18:16:02.761938Z info FLAG: --templateFile="" 2026-11-03T18:16:02.761942Z info FLAG: --tokenManagerPlugin="" 2026-11-03T18:16:02.761946Z info FLAG: --vklog="0" 2026-11-03T18:16:02.761950Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T18:16:02.762144Z info Proxy role ips=[10.132.0.163] type=router id=maas-default-gateway-openshift-default-5df48fcc99-r96r9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T18:16:02.762213Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T18:16:02.764128Z info cpu limit detected as 2, setting concurrency 2026-11-03T18:16:02.765022Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T18:16:02.765096Z info JWT policy is third-party-jwt 2026-11-03T18:16:02.765127Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T18:16:02.769439Z info Starting default Istio SDS Server 2026-11-03T18:16:02.769723Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T18:16:02.769523Z info Opening status port 15020 2026-11-03T18:16:02.769829Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T18:16:02.775782Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T18:16:02.777643Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T18:16:02.779007Z info Starting proxy agent 2026-11-03T18:16:02.779061Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T18:16:02.782997Z info sds Starting SDS grpc server 2026-11-03T18:16:02.783089Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T18:16:02.945515Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T18:16:03.068791Z info cache generated new workload certificate resourceName=default latency=297.803292ms ttl=23h59m59.931213557s 2026-11-03T18:16:03.068910Z info cache Root cert has changed, start rotating root cert 2026-11-03T18:16:03.068990Z info cache returned workload trust anchor from cache ttl=23h59m59.9310112s 2026-11-03T18:16:03.265920Z info ads ADS: new connection for node:1 2026-11-03T18:16:03.266073Z info cache returned workload certificate from cache ttl=23h59m59.733929688s 2026-11-03T18:16:03.268108Z info ads ADS: new connection for node:2 2026-11-03T18:16:03.269146Z info cache returned workload trust anchor from cache ttl=23h59m59.730857233s 2026-11-03T18:16:03.380505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:16:12.579816Z info Readiness succeeded in 9.821066662s 2026-11-03T18:16:12.580229Z info Envoy proxy is ready 2026-11-03T18:16:41.184735Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:58.873551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:22:59.047466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:59.047505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:59.047520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:59.047525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T18:22:58.909Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 137 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "06cb5716-66cd-4bbd-8c5b-270a4ce9dae7" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.134.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.163:42600 10.132.0.163:443 10.132.0.12:54154 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:23:25.568021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:24.576801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:24:30.992Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "bb396763-3e98-4bf3-9e50-07da1de26d75" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:51406 10.132.0.163:443 10.132.0.12:38360 - v1-completions-path 2026-11-03T18:24:45.936528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:50.899873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:25:03.300Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "4702e8b8-f330-4656-90f2-de07b31377d5" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.163:443 10.132.0.12:50522 - v1-completions-path 2026-11-03T18:25:21.088826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:25:34.411061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:25:42.183Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e0e5244c-a4e1-4bcf-ba48-b856886e4ac5" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:51406 10.132.0.163:443 10.132.0.12:44342 - v1-completions-path [2026-11-03T18:25:44.006Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3d9963ce-ec9a-431e-a2aa-32d2dfebafc0" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:56200 10.132.0.163:443 10.132.0.12:44360 - v1-completions-path 2026-11-03T18:25:44.538997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T18:25:44.533Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "fc2a1997-7947-460c-8b33-25e8a8d7e18d" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:51406 10.132.0.163:443 10.132.0.12:44362 - v1-completions-path [2026-11-03T18:25:45.064Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c7b6e3a2-96e2-4bec-85dc-0d181d04afc0" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:56200 10.132.0.163:443 10.132.0.12:44376 - v1-completions-path 2026-11-03T18:26:05.335266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:16.106063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:22.816464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:37.512612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-03T18:26:37.451Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "cfa7e42e-4c89-42a4-ba8b-86c558193540" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:56200 10.132.0.163:443 10.132.0.12:38564 - v1-completions-path [2026-11-03T18:26:39.047Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "c09d0128-7c67-4888-a509-869a52dfb16e" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:51406 10.132.0.163:443 10.132.0.12:38580 - v1-completions-path [2026-11-03T18:26:39.305Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "429d00df-6e6f-4e04-821f-a63919a78724" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:51406 10.132.0.163:443 10.132.0.12:38592 - v1-completions-path [2026-11-03T18:26:40.071Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "bb8def46-950b-4b2c-a10a-e628073fbe44" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.163:56200 10.132.0.163:443 10.132.0.12:38594 - v1-completions-path 2026-11-03T18:26:54.240277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:59.192367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:27:25.728977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:27:32.429079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:01.441850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:23.508300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:36.673301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:42.742777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:07.475515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:13.215767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:34.568614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:56.222390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:07.000171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:26.046022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:32.038053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:32:54.970154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:33:01.235344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:41.359741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:58.794639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:03.580274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:27.944180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:37:34.839770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:38:20.823376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:38:48.110787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:03.655403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:22.773245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:35.251785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:40.139336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:07.993820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:43:39.617745Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T18:43:53.667434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:05.181628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:11.113482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:44:11.113517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:44:11.113533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T18:44:11.113538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T18:44:10.993Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 119 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "689d8eab-81cc-469f-9fe4-1e387c49b4b9" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.205:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.163:53244 10.132.0.163:443 10.132.0.12:34444 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:44:26.370180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:31.128515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:48.479323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:45:00.338127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9