2026-10-31T00:40:54.699875Z info FLAG: --concurrency="0" 2026-10-31T00:40:54.699894Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T00:40:54.699898Z info FLAG: --help="false" 2026-10-31T00:40:54.699900Z info FLAG: --log_as_json="false" 2026-10-31T00:40:54.699902Z info FLAG: --log_caller="" 2026-10-31T00:40:54.699904Z info FLAG: --log_output_level="default:info" 2026-10-31T00:40:54.699906Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T00:40:54.699911Z info FLAG: --log_target="[stdout]" 2026-10-31T00:40:54.699913Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T00:40:54.699915Z info FLAG: --outlierLogPath="" 2026-10-31T00:40:54.699917Z info FLAG: --profiling="true" 2026-10-31T00:40:54.699920Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T00:40:54.699922Z info FLAG: --proxyLogLevel="warning" 2026-10-31T00:40:54.699924Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T00:40:54.699926Z info FLAG: --stsPort="0" 2026-10-31T00:40:54.699928Z info FLAG: --templateFile="" 2026-10-31T00:40:54.699930Z info FLAG: --tokenManagerPlugin="" 2026-10-31T00:40:54.699933Z info FLAG: --vklog="0" 2026-10-31T00:40:54.699936Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T00:40:54.700080Z info Proxy role ips=[10.133.0.76] type=router id=maas-default-gateway-openshift-default-6886b96f9-cdzdr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T00:40:54.700134Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T00:40:54.701230Z info cpu limit detected as 2, setting concurrency 2026-10-31T00:40:54.701441Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T00:40:54.701454Z info JWT policy is third-party-jwt 2026-10-31T00:40:54.701458Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T00:40:54.703147Z info Starting default Istio SDS Server 2026-10-31T00:40:54.703171Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T00:40:54.703187Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T00:40:54.703410Z info Opening status port 15020 2026-10-31T00:40:54.704333Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T00:40:54.705165Z info sds Starting SDS grpc server 2026-10-31T00:40:54.705180Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T00:40:54.705638Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T00:40:54.706397Z info Starting proxy agent 2026-10-31T00:40:54.706426Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T00:40:54.774090Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T00:40:54.981838Z info ads ADS: new connection for node:1 2026-10-31T00:40:54.982428Z info ads ADS: new connection for node:2 2026-10-31T00:40:54.997435Z info cache generated new workload certificate resourceName=default latency=292.10282ms ttl=23h59m59.002568567s 2026-10-31T00:40:54.997474Z info cache Root cert has changed, start rotating root cert 2026-10-31T00:40:54.997504Z info cache returned workload certificate from cache ttl=23h59m59.002500094s 2026-10-31T00:40:54.997514Z info cache returned workload trust anchor from cache ttl=23h59m59.00248638s 2026-10-31T00:40:54.997574Z info cache returned workload trust anchor from cache ttl=23h59m59.002426902s 2026-10-31T00:40:54.998024Z info cache returned workload trust anchor from cache ttl=23h59m59.001977534s 2026-10-31T00:40:55.089059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:41:03.242495Z info Readiness succeeded in 8.545002691s 2026-10-31T00:41:03.242867Z info Envoy proxy is ready 2026-10-31T00:41:37.990357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:52:42.914251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:54:32.100332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:55:57.317244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:56:07.298732Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T01:01:48.244223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:02:12.516339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:03:07.460656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:03:14.474Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 89 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "0f7b4b6b-ca96-46f4-b7e7-89ef274c84b6" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.76:58888 10.133.0.76:443 10.132.0.9:46694 - v1-completions-path [2026-10-31T01:03:14.859Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "fa6bc44f-17d6-4dbf-91cb-ade68b0ec50e" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.76:58888 10.133.0.76:443 10.132.0.9:46716 - v1-completions-path 2026-10-31T01:03:28.858051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:03:35.178143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:03:46.662Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 66 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "7f90eb9c-8cdf-46b2-b622-38bc5c12f3b1" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.76:443 10.132.0.9:48408 - v1-completions-path 2026-10-31T01:04:00.575545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:04:17.747753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:04:24.702453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:04:24.702494Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:04:24.702513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:04:24.702519Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T01:04:24.583Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 320 119 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "be8f5b87-a6fa-42f1-b693-e051f119a146" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.76:39732 10.133.0.76:443 10.132.0.9:59932 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T01:04:27.763Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "5959f868-d4d1-4570-9965-5074782fe7d6" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.76:58888 10.133.0.76:443 10.132.0.9:59952 - v1-completions-path 2026-10-31T01:04:48.453180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:04:59.269853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:05:05.626287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:05:20.511818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-31T01:05:20.460Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ae680e9d-c5a1-4aa6-a35b-f1f23dee663a" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.76:58888 10.133.0.76:443 10.132.0.9:59050 - v1-completions-path 2026-10-31T01:05:34.549433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:05:39.110449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:02.652063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:09.131348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:35.408453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:06:57.563963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:10.810719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:16.662284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:41.870895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:07:47.480633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T01:07:57.157Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 78 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "bbb9ce00-f0ea-4dca-a697-a6fb5f2f1e57" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.134.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.76:47318 10.133.0.76:443 10.132.0.9:59464 - v1-completions-path 2026-10-31T01:08:06.325689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:27.979163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:38.770428Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:08:57.983905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:09:03.653218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:04.246184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:21.820905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:26.706889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:13:36.562763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:13:36.562798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:13:36.562811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T01:13:36.562816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T01:13:36.445Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 117 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3181f2b3-c018-474d-a9c2-7419aaa2f226" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.76:60146 10.133.0.76:443 10.132.0.9:44320 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:13:50.958667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:16:01.714169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:16:41.395778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:11.016904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:26.936236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:34.569145Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:44.508204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:17:49.578653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:18:12.495800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:21:54.330253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:00.933751Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:22:00.933786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:22:00.933800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T01:22:00.933805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T01:22:00.813Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 120 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a5e7ec2e-ecb7-42bc-a194-d0d310bc18a6" "maas.apps.c55b3c5f5a7211f8ab99.prod.konflux-ocp-ci.dev" "10.133.0.126:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.76:47744 10.133.0.76:443 10.132.0.9:52766 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T01:22:06.274541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:27.553337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:32.263148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:22:48.670715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:23:00.354703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T01:23:38.315307Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3