2026-10-30T01:34:29.557368Z info FLAG: --concurrency="0" 2026-10-30T01:34:29.557389Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T01:34:29.557393Z info FLAG: --help="false" 2026-10-30T01:34:29.557395Z info FLAG: --log_as_json="false" 2026-10-30T01:34:29.557397Z info FLAG: --log_caller="" 2026-10-30T01:34:29.557399Z info FLAG: --log_output_level="default:info" 2026-10-30T01:34:29.557401Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T01:34:29.557405Z info FLAG: --log_target="[stdout]" 2026-10-30T01:34:29.557408Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T01:34:29.557410Z info FLAG: --outlierLogPath="" 2026-10-30T01:34:29.557412Z info FLAG: --profiling="true" 2026-10-30T01:34:29.557414Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T01:34:29.557416Z info FLAG: --proxyLogLevel="warning" 2026-10-30T01:34:29.557418Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T01:34:29.557420Z info FLAG: --stsPort="0" 2026-10-30T01:34:29.557422Z info FLAG: --templateFile="" 2026-10-30T01:34:29.557424Z info FLAG: --tokenManagerPlugin="" 2026-10-30T01:34:29.557426Z info FLAG: --vklog="0" 2026-10-30T01:34:29.557429Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T01:34:29.557596Z info Proxy role ips=[10.132.1.179] type=router id=maas-default-gateway-openshift-default-67bf986f99-fwnrr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T01:34:29.557646Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T01:34:29.558712Z info cpu limit detected as 2, setting concurrency 2026-10-30T01:34:29.558902Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T01:34:29.558912Z info JWT policy is third-party-jwt 2026-10-30T01:34:29.558915Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T01:34:29.560208Z info Starting default Istio SDS Server 2026-10-30T01:34:29.560235Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T01:34:29.560262Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T01:34:29.560694Z info Opening status port 15020 2026-10-30T01:34:29.561938Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T01:34:29.562226Z info sds Starting SDS grpc server 2026-10-30T01:34:29.562261Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T01:34:29.563206Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T01:34:29.564114Z info Starting proxy agent 2026-10-30T01:34:29.564158Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T01:34:29.630544Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T01:34:29.718834Z info cache generated new workload certificate resourceName=default latency=156.497951ms ttl=23h59m59.281171169s 2026-10-30T01:34:29.718871Z info cache Root cert has changed, start rotating root cert 2026-10-30T01:34:29.718905Z info cache returned workload trust anchor from cache ttl=23h59m59.281095756s 2026-10-30T01:34:29.745948Z info ads ADS: new connection for node:1 2026-10-30T01:34:29.746020Z info cache returned workload certificate from cache ttl=23h59m59.253982164s 2026-10-30T01:34:29.746377Z info ads ADS: new connection for node:2 2026-10-30T01:34:29.746524Z info cache returned workload trust anchor from cache ttl=23h59m59.253478122s 2026-10-30T01:34:29.838653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:38.397999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:39.341697Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:34:40.172371Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:34:40.443503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:41.382401Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:34:42.215544Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:34:42.621743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:34:42.646232Z info Readiness succeeded in 13.091126033s 2026-10-30T01:34:42.646970Z info Envoy proxy is ready 2026-10-30T01:34:47.599446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:34:53.054Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 86 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "cd04d764-cb98-4014-a16b-ff52d61cb04a" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:33016 10.132.1.179:443 10.132.0.13:42554 - v1-completions-path [2026-10-30T01:34:54.710Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "5b4d9c5b-fefe-4923-a584-168e76b3c5fd" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:33030 10.132.1.179:443 10.132.0.13:42570 - v1-completions-path 2026-10-30T01:35:10.604565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:20.989544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:25.413840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T01:35:29.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 56 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "3db57a03-dbd1-4ec0-ac71-c2be2ca807e9" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:33030 10.132.1.179:443 10.132.0.13:49840 - v1-completions-path [2026-10-30T01:35:30.115Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "8344497b-186f-430f-bb89-89684e2f4394" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:33016 10.132.1.179:443 10.132.0.13:49850 - v1-completions-path 2026-10-30T01:35:42.666701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:35:44.819523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:03.748390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:08.079806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:23.766757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:25.962669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:44.882318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:55.536649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:36:58.720879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:38:54.138018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:38:54.138058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:38:54.138073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T01:38:54.138078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T01:38:54.050Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 87 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "de20aa08-9a67-4d61-bbf2-0290f12a3012" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.179:33154 10.132.1.179:443 10.132.0.13:46960 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:40:34.817689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:50.129738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:40:52.279850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:41:05.011480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:22.955417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:42.115389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:42:55.720502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:08.305317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:12.067908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:14.799882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T01:43:14.799921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T01:43:14.799934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T01:43:14.799939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T01:43:14.746Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 53 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "39bfc623-2ba8-48c9-84fe-1fcae355d689" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.179:37028 10.132.1.179:443 10.132.0.13:53804 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:43:15.923030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:26.684012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:30.798563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:49.140098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:43:58.634971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:04.173079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T01:44:04.190838Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T01:44:04.118Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 72 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "9af28b21-00d1-4641-89c2-2a5fa4d86d28" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:48022 10.132.1.179:443 10.132.0.13:49232 - v1-catch-all-path 2026-10-30T01:44:04.276024Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T01:44:04.216Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 59 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "585463f5-a448-4cae-a5d4-60036d6b8b50" "maas.apps.492a45542c896257e959.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.179:48022 10.132.1.179:443 10.132.0.13:49242 - v1-catch-all-model-routing 2026-10-30T01:44:06.542173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:20.811235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:23.123852Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:38.261377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T01:44:49.207336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8