2026-11-02T22:29:16.660913Z info FLAG: --concurrency="0" 2026-11-02T22:29:16.660934Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T22:29:16.660939Z info FLAG: --help="false" 2026-11-02T22:29:16.660943Z info FLAG: --log_as_json="false" 2026-11-02T22:29:16.660946Z info FLAG: --log_caller="" 2026-11-02T22:29:16.660949Z info FLAG: --log_output_level="default:info" 2026-11-02T22:29:16.660952Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T22:29:16.660959Z info FLAG: --log_target="[stdout]" 2026-11-02T22:29:16.660963Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T22:29:16.660966Z info FLAG: --outlierLogPath="" 2026-11-02T22:29:16.660969Z info FLAG: --profiling="true" 2026-11-02T22:29:16.660972Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T22:29:16.660975Z info FLAG: --proxyLogLevel="warning" 2026-11-02T22:29:16.660979Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T22:29:16.660982Z info FLAG: --stsPort="0" 2026-11-02T22:29:16.660984Z info FLAG: --templateFile="" 2026-11-02T22:29:16.660987Z info FLAG: --tokenManagerPlugin="" 2026-11-02T22:29:16.660997Z info FLAG: --vklog="0" 2026-11-02T22:29:16.661001Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T22:29:16.661209Z info Proxy role ips=[10.132.0.97] type=router id=maas-default-gateway-openshift-default-76f4876667-m5kv8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T22:29:16.661270Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T22:29:16.662407Z info cpu limit detected as 2, setting concurrency 2026-11-02T22:29:16.662626Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T22:29:16.662639Z info JWT policy is third-party-jwt 2026-11-02T22:29:16.662643Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T22:29:16.665998Z info Starting default Istio SDS Server 2026-11-02T22:29:16.666076Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T22:29:16.666128Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T22:29:16.665995Z info Opening status port 15020 2026-11-02T22:29:16.666946Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T22:29:16.667282Z info sds Starting SDS grpc server 2026-11-02T22:29:16.667306Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T22:29:16.668236Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T22:29:16.669174Z info Starting proxy agent 2026-11-02T22:29:16.669214Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T22:29:16.746107Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T22:29:16.788502Z info cache generated new workload certificate resourceName=default latency=121.060847ms ttl=23h59m59.211503462s 2026-11-02T22:29:16.788558Z info cache Root cert has changed, start rotating root cert 2026-11-02T22:29:16.788596Z info cache returned workload trust anchor from cache ttl=23h59m59.211404293s 2026-11-02T22:29:16.972057Z info ads ADS: new connection for node:1 2026-11-02T22:29:16.972136Z info cache returned workload certificate from cache ttl=23h59m59.027866119s 2026-11-02T22:29:16.973192Z info ads ADS: new connection for node:2 2026-11-02T22:29:16.973287Z info cache returned workload trust anchor from cache ttl=23h59m59.026714227s 2026-11-02T22:29:17.084757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:29:25.992346Z info Readiness succeeded in 9.343185307s 2026-11-02T22:29:25.992970Z info Envoy proxy is ready 2026-11-02T22:30:24.564914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:35:23.816831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:35:23.816867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:35:23.816879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:35:23.816884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T22:35:23.691Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 125 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "8de6ab82-35e3-48c5-8346-a5ad7fbb92ed" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.97:38376 10.132.0.97:443 10.132.0.10:56590 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:35:25.093380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:35:48.583924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:36:46.179827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:37:07.568636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:37:12.073550Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:37:39.031684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:05.751712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:38:13.305Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 87 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "7e248935-cb22-40c6-a821-2ce5b68bdb54" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.97:51392 10.132.0.97:443 10.132.0.10:55160 - v1-completions-path [2026-11-02T22:38:13.679Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "47da2d7b-167a-4414-bea1-06b29276cedc" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.97:51402 10.132.0.97:443 10.132.0.10:55164 - v1-completions-path 2026-11-02T22:38:16.395086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T22:38:16.338Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "1e6e14f0-12bf-4f80-af74-3099b518ac28" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.97:51392 10.132.0.97:443 10.132.0.10:50314 - v1-completions-path 2026-11-02T22:38:36.445750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:47.183154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:38:53.497746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:39:08.414Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "aec81d94-3ccb-482b-a0eb-028c22aacb39" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.97:51392 10.132.0.97:443 10.132.0.10:57458 - v1-completions-path 2026-11-02T22:39:25.657399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:39:30.297447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:39:53.752880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:00.138054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:26.264458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:40:48.392218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:01.412029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:07.411803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:32.161641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:41:37.454284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T22:41:47.796Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 35 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "45373e27-7190-4a4b-8454-981992440822" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.97:443 10.132.0.10:58156 - v1-completions-path 2026-11-02T22:41:57.939005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:42:31.177519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:42:41.873660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:43:11.176454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:43:16.937831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:45:38.779693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:45:44.657565Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:27.808103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:45.272263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:47:49.890162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:48:14.412794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:50:10.133202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:50:10.133237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:50:10.133251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:50:10.133255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:50:10.412220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:50:10.412251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:50:10.412262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:50:10.412267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:50:10.069Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 64 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "27827cd1-8445-48a2-a2a2-884c7eb2da2d" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.97:51736 10.132.0.97:443 10.132.0.10:38764 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:50:10.359Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 52 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a17f4adf-4640-43fb-aba7-7cd54bd2ada4" "maas.apps.330416457e2a532a0aba.prod.konflux-ocp-ci.dev" "10.134.0.43:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.97:51752 10.132.0.97:443 10.132.0.10:38772 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:50:18.464848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:50:59.116219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:27.255571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:43.227024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:51:52.218204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:52:06.014177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:52:11.011256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:52:33.878303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:56:36.966358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:56:48.292273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:19.275096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:24.017358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:57:48.443845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:58:00.478718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T22:59:11.751178Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2