2026-11-01T03:54:48.110631Z info FLAG: --concurrency="0" 2026-11-01T03:54:48.110662Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T03:54:48.110666Z info FLAG: --help="false" 2026-11-01T03:54:48.110668Z info FLAG: --log_as_json="false" 2026-11-01T03:54:48.110670Z info FLAG: --log_caller="" 2026-11-01T03:54:48.110673Z info FLAG: --log_output_level="default:info" 2026-11-01T03:54:48.110675Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T03:54:48.110679Z info FLAG: --log_target="[stdout]" 2026-11-01T03:54:48.110682Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T03:54:48.110684Z info FLAG: --outlierLogPath="" 2026-11-01T03:54:48.110686Z info FLAG: --profiling="true" 2026-11-01T03:54:48.110688Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T03:54:48.110690Z info FLAG: --proxyLogLevel="warning" 2026-11-01T03:54:48.110692Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T03:54:48.110695Z info FLAG: --stsPort="0" 2026-11-01T03:54:48.110696Z info FLAG: --templateFile="" 2026-11-01T03:54:48.110698Z info FLAG: --tokenManagerPlugin="" 2026-11-01T03:54:48.110701Z info FLAG: --vklog="0" 2026-11-01T03:54:48.110703Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T03:54:48.110842Z info Proxy role ips=[10.133.1.7] type=router id=maas-default-gateway-openshift-default-7c5b899d5f-cf66s.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T03:54:48.110888Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T03:54:48.112081Z info cpu limit detected as 2, setting concurrency 2026-11-01T03:54:48.112382Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T03:54:48.112392Z info JWT policy is third-party-jwt 2026-11-01T03:54:48.112395Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T03:54:48.115188Z info Starting default Istio SDS Server 2026-11-01T03:54:48.115223Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T03:54:48.115248Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T03:54:48.115769Z info Opening status port 15020 2026-11-01T03:54:48.116325Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T03:54:48.117500Z info sds Starting SDS grpc server 2026-11-01T03:54:48.117648Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T03:54:48.118313Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T03:54:48.119447Z info Starting proxy agent 2026-11-01T03:54:48.119489Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T03:54:48.213707Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T03:54:48.366967Z info cache generated new workload certificate resourceName=default latency=249.161739ms ttl=23h59m59.633038224s 2026-11-01T03:54:48.367016Z info cache Root cert has changed, start rotating root cert 2026-11-01T03:54:48.367062Z info cache returned workload trust anchor from cache ttl=23h59m59.632938784s 2026-11-01T03:54:48.401188Z info ads ADS: new connection for node:1 2026-11-01T03:54:48.401265Z info cache returned workload certificate from cache ttl=23h59m59.59873691s 2026-11-01T03:54:48.401991Z info ads ADS: new connection for node:2 2026-11-01T03:54:48.402298Z info cache returned workload trust anchor from cache ttl=23h59m59.597703968s 2026-11-01T03:54:48.493085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:54:58.341330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:54:59.188978Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T03:54:59.606189Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T03:55:01.301785Z info Readiness succeeded in 13.194588214s 2026-11-01T03:55:01.302352Z info Envoy proxy is ready 2026-11-01T03:55:38.801418Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T03:55:38.801447Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T03:55:38.801452Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T03:55:38.801456Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-01T03:55:38.750Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 51 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "4b6dbfeb-34e3-4039-bde9-f891bddf61a5" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.7:443 10.133.0.15:39348 - v1-completions-path 2026-11-01T03:55:48.811351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:56:09.958178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:56:14.725452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T03:56:26.955Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 66 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "5c33e39c-5d8e-4a68-98be-53b6b4e1efef" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.7:443 10.133.0.15:32846 - v1-completions-path 2026-11-01T03:56:41.118678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:56:57.835499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:57:28.911673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:57:39.696748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:57:46.260713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T03:58:01.103Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 76 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "0a04ee35-5b96-45c9-8820-3929c660dc93" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.7:52248 10.133.1.7:443 10.133.0.15:58808 - v1-completions-path [2026-11-01T03:58:02.996Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "bbc5e16e-0da2-4878-8751-19815ce8cddf" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.7:52248 10.133.1.7:443 10.133.0.15:58822 - v1-completions-path 2026-11-01T03:58:17.685079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:58:22.470799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:58:45.757958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:58:52.241928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:59:18.225632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:59:40.452684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:59:53.524656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T03:59:59.538308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:00:27.258541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:00:32.841505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:00:51.129715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:01:13.023492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:01:23.727454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:01:42.323521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:01:48.223700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:05:45.644635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:06:02.990677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:06:07.679733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:06:31.909790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:08:40.338356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:09:23.719632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:09:53.687281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:05.918092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:12.143854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:18.886247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T04:10:18.886284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T04:10:18.886298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T04:10:18.886303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T04:10:18.764Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 121 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "5111e633-c122-4a11-b6ac-c6704de41b89" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "10.132.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.7:49574 10.133.1.7:443 10.133.0.15:60190 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T04:10:19.403549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:24.083056Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:34.272266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:10:38.922329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T04:10:47.673Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "249159e3-506c-456e-ba67-9ee27036f273" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.7:33788 10.133.1.7:443 10.133.0.15:57992 - v1-completions-path [2026-11-01T04:10:48.467Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.133.0.15" "python-requests/2.34.2" "0cdc9762-f405-4ab9-bc42-7b5ee95a17e0" "maas.apps.6dee542eea5b9fb4e29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.7:443 10.133.0.15:57994 - v1-completions-path 2026-11-01T04:11:02.456254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:14:37.240227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:14:48.895410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:15:10.183954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:15:15.066572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:15:31.147255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T04:15:42.876278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8