2026-11-02T02:16:40.636108Z info FLAG: --concurrency="0" 2026-11-02T02:16:40.636127Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T02:16:40.636132Z info FLAG: --help="false" 2026-11-02T02:16:40.636134Z info FLAG: --log_as_json="false" 2026-11-02T02:16:40.636136Z info FLAG: --log_caller="" 2026-11-02T02:16:40.636138Z info FLAG: --log_output_level="default:info" 2026-11-02T02:16:40.636140Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T02:16:40.636144Z info FLAG: --log_target="[stdout]" 2026-11-02T02:16:40.636147Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T02:16:40.636148Z info FLAG: --outlierLogPath="" 2026-11-02T02:16:40.636151Z info FLAG: --profiling="true" 2026-11-02T02:16:40.636153Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T02:16:40.636155Z info FLAG: --proxyLogLevel="warning" 2026-11-02T02:16:40.636157Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T02:16:40.636159Z info FLAG: --stsPort="0" 2026-11-02T02:16:40.636161Z info FLAG: --templateFile="" 2026-11-02T02:16:40.636163Z info FLAG: --tokenManagerPlugin="" 2026-11-02T02:16:40.636166Z info FLAG: --vklog="0" 2026-11-02T02:16:40.636168Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T02:16:40.636300Z info Proxy role ips=[10.132.0.140] type=router id=maas-default-gateway-openshift-default-c9ffffc7f-k28rd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T02:16:40.636344Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T02:16:40.637386Z info cpu limit detected as 2, setting concurrency 2026-11-02T02:16:40.637607Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T02:16:40.637618Z info JWT policy is third-party-jwt 2026-11-02T02:16:40.637621Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T02:16:40.639296Z info Starting default Istio SDS Server 2026-11-02T02:16:40.639327Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T02:16:40.639344Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T02:16:40.639434Z info Opening status port 15020 2026-11-02T02:16:40.640227Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T02:16:40.642112Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T02:16:40.643619Z info Starting proxy agent 2026-11-02T02:16:40.643660Z info sds Starting SDS grpc server 2026-11-02T02:16:40.644396Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T02:16:40.644372Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T02:16:40.707062Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T02:16:40.774773Z info cache generated new workload certificate resourceName=default latency=134.250789ms ttl=23h59m59.225232034s 2026-11-02T02:16:40.774811Z info cache Root cert has changed, start rotating root cert 2026-11-02T02:16:40.774845Z info cache returned workload trust anchor from cache ttl=23h59m59.225156847s 2026-11-02T02:16:40.859127Z info ads ADS: new connection for node:1 2026-11-02T02:16:40.859203Z info cache returned workload certificate from cache ttl=23h59m59.140800223s 2026-11-02T02:16:40.859222Z info ads ADS: new connection for node:2 2026-11-02T02:16:40.859305Z info cache returned workload trust anchor from cache ttl=23h59m59.140696239s 2026-11-02T02:16:40.948322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:16:48.997595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:16:50.160828Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T02:16:51.383119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:16:52.301235Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T02:16:53.217978Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T02:16:53.846806Z info Readiness succeeded in 13.213281542s 2026-11-02T02:16:53.847222Z info Envoy proxy is ready 2026-11-02T02:17:20.098630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:17:33.349396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T02:17:43.661Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 85 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4997a1e3-9159-4981-bf79-34fd57b7880e" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:34996 10.132.0.140:443 10.132.0.19:36508 - v1-completions-path [2026-11-02T02:17:46.294Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "688b94e7-80cc-4e9e-9aeb-82420c32cf9e" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:34996 10.132.0.140:443 10.132.0.19:36520 - v1-completions-path [2026-11-02T02:17:46.556Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0f13bf03-044e-40d7-b9a7-5a3c52168cd2" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:35004 10.132.0.140:443 10.132.0.19:36528 - v1-completions-path 2026-11-02T02:18:04.525881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:18:15.106426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:18:21.580804Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:18:35.025842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T02:18:34.916Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 110 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f9a83513-e101-4a7e-9662-e2943b01b405" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:34996 10.132.0.140:443 10.132.0.19:54456 - v1-completions-path [2026-11-02T02:18:36.017Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "43c7481b-eda9-4e7f-8c71-b1cbc484ebe4" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:34996 10.132.0.140:443 10.132.0.19:54468 - v1-completions-path 2026-11-02T02:18:49.936426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:18:54.594556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:19:17.927178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:19:24.294528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:19:50.389827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:20:12.506544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:20:25.622600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:20:31.526942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:20:59.554173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:21:05.056407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T02:21:16.953Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 38 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "226ab698-84d7-4f93-83da-7b87318e0e47" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.140:443 10.132.0.19:46178 - v1-completions-path 2026-11-02T02:21:25.081653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:21:33.885636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T02:21:33.885701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T02:21:33.885716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T02:21:33.885721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T02:21:33.770Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 308 115 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "66b16a67-1614-4af1-a60e-273da1e9fc3b" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.133.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.140:38388 10.132.0.140:443 10.132.0.19:49598 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:21:48.551691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:21:59.035889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:22:18.122656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:22:24.060503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:24:49.722663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:24:55.589527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:26:31.198719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-02T02:26:33.701Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 215 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "edeae7fd-47fa-453f-840c-5c4f5869840d" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.140:38202 10.132.0.140:443 10.132.0.19:52842 - v1-completions-path 2026-11-02T02:26:48.546385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:26:53.234535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:27:17.547877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:29:05.006361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T02:29:05.006402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T02:29:05.006424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T02:29:05.006429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T02:29:04.892Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 113 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "dca390ac-f88a-41fa-ac16-f7ccec4495be" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.133.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.140:37586 10.132.0.140:443 10.132.0.19:35164 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:29:13.276943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:29:57.190374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:30:24.425120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:30:37.864045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:30:46.626796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:31:00.022363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:31:04.861705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:31:12.632308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T02:31:12.632345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T02:31:12.632360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T02:31:12.632365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T02:31:12.577Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 54 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "54a3ce8b-55f8-4777-b440-c961efc4982f" "maas.apps.d4a95e5a5c3bbef66424.prod.konflux-ocp-ci.dev" "10.133.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.140:56736 10.132.0.140:443 10.132.0.19:54998 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:31:26.223305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:35:02.170566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:35:12.663584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:35:33.678881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:35:38.236391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:35:54.606873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-02T02:36:06.365976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9