2026-10-30T23:44:10.950172Z info FLAG: --concurrency="0" 2026-10-30T23:44:10.950195Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T23:44:10.950233Z info FLAG: --help="false" 2026-10-30T23:44:10.950236Z info FLAG: --log_as_json="false" 2026-10-30T23:44:10.950240Z info FLAG: --log_caller="" 2026-10-30T23:44:10.950243Z info FLAG: --log_output_level="default:info" 2026-10-30T23:44:10.950246Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T23:44:10.950252Z info FLAG: --log_target="[stdout]" 2026-10-30T23:44:10.950256Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T23:44:10.950258Z info FLAG: --outlierLogPath="" 2026-10-30T23:44:10.950261Z info FLAG: --profiling="true" 2026-10-30T23:44:10.950264Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T23:44:10.950268Z info FLAG: --proxyLogLevel="warning" 2026-10-30T23:44:10.950272Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T23:44:10.950275Z info FLAG: --stsPort="0" 2026-10-30T23:44:10.950278Z info FLAG: --templateFile="" 2026-10-30T23:44:10.950281Z info FLAG: --tokenManagerPlugin="" 2026-10-30T23:44:10.950285Z info FLAG: --vklog="0" 2026-10-30T23:44:10.950289Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T23:44:10.950479Z info Proxy role ips=[10.132.0.109] type=router id=maas-default-gateway-openshift-default-5df48fcc99-ghblg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T23:44:10.950543Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T23:44:10.951658Z info cpu limit detected as 2, setting concurrency 2026-10-30T23:44:10.951875Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T23:44:10.951889Z info JWT policy is third-party-jwt 2026-10-30T23:44:10.951894Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T23:44:10.953748Z info Starting default Istio SDS Server 2026-10-30T23:44:10.953779Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T23:44:10.953805Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T23:44:10.953983Z info Opening status port 15020 2026-10-30T23:44:10.954996Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T23:44:10.955982Z info sds Starting SDS grpc server 2026-10-30T23:44:10.956004Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T23:44:10.956396Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T23:44:10.957419Z info Starting proxy agent 2026-10-30T23:44:10.957494Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T23:44:11.034062Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T23:44:11.037832Z info cache generated new workload certificate resourceName=default latency=81.657401ms ttl=23h59m59.962171665s 2026-10-30T23:44:11.037912Z info cache Root cert has changed, start rotating root cert 2026-10-30T23:44:11.037970Z info cache returned workload trust anchor from cache ttl=23h59m59.962031306s 2026-10-30T23:44:11.266813Z info ads ADS: new connection for node:1 2026-10-30T23:44:11.266873Z info cache returned workload certificate from cache ttl=23h59m59.733129054s 2026-10-30T23:44:11.267021Z info ads ADS: new connection for node:2 2026-10-30T23:44:11.267097Z info cache returned workload trust anchor from cache ttl=23h59m59.732904479s 2026-10-30T23:44:11.366992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:44:23.221559Z warn xdsproxy sendDownstreamDelta took 11.764011803s 2026-10-30T23:44:23.279091Z info Readiness succeeded in 12.332653354s 2026-10-30T23:44:23.279437Z info Envoy proxy is ready 2026-10-30T23:45:03.160535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:46:30.662930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:47:05.071916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:48:18.372843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:51:21.997996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:53:28.684707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:43.059465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:05.670698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:50.612077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:04:54.750Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 68 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "62c4447f-45ce-4b40-9968-a6adc976e7d2" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.109:443 10.132.0.10:51150 - v1-completions-path 2026-10-31T00:05:06.244438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:08.260419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:05:13.185Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 76 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "987449fe-f8d6-49eb-aaf0-150dd288d9d4" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.109:34230 10.132.0.109:443 10.132.0.10:42454 - v1-completions-path 2026-10-31T00:05:25.209026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:27.106279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:30.149485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:38.082949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:43.921448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:05:43.921482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:05:43.921495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:05:43.921500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:05:43.856Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 77 319 65 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "1569474d-9449-460a-8db8-41ac708e2159" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.109:47836 10.132.0.109:443 10.132.0.10:51382 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:06:02.473631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:12.786193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:14.592558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:33.738511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:35.481336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:06:40.219Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 297 78 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "e00a37fa-6284-4a9a-831e-c42634f6394d" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.109:46606 10.132.0.109:443 10.132.0.10:59128 - v1-completions-path 2026-10-31T00:06:51.940972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:06:54.156348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:10.590357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:12.322267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:26.614860Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-31T00:07:28.528696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:39.228403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:42.031142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:03.970207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.970240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.970252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:08:03.970257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:08:03.908Z] "DELETE /v1/api-keys/e0a4a689-8801-46df-980e-397764b7fc2d HTTP/1.1" 404 - via_upstream - "-" 0 29 61 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "009a95b7-99d5-49b8-b9ba-fe67ddadf28a" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.109:58522 10.132.0.109:443 10.132.0.10:48736 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T00:08:05.436Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 31 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "442a62ec-34c3-4326-8048-259dab49da4d" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.109:443 10.132.0.10:48744 - v1-completions-path 2026-10-31T00:08:07.876276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:26.195285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:36.530372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:53.121302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:08:56.207251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:10:29.628Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "23f58c9e-b3b8-4c79-a9b3-f959485fb08f" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.109:443 10.132.0.10:51064 - v1-completions-path 2026-10-31T00:11:54.594791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:09.555516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:11.312772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:28.585365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:51.713717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:13:51.713750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:13:51.713763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T00:13:51.713769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T00:13:51.633Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 80 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "2a456ff9-3637-4b22-babc-9069eba33911" "maas.apps.5568f4f21be02ef293a6.prod.konflux-ocp-ci.dev" "10.132.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.109:53994 10.132.0.109:443 10.132.0.10:59238 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:13:56.130786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:12.561482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:28.496908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:40.423684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:43.518886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:52.346249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:54.825824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:15:13.109322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:02.675725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:07.765980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:22.839909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:24.423556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:38.633230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:49.620205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8