2026-10-30T18:42:21.922130Z info FLAG: --concurrency="0" 2026-10-30T18:42:21.922152Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T18:42:21.922157Z info FLAG: --help="false" 2026-10-30T18:42:21.922161Z info FLAG: --log_as_json="false" 2026-10-30T18:42:21.922164Z info FLAG: --log_caller="" 2026-10-30T18:42:21.922168Z info FLAG: --log_output_level="default:info" 2026-10-30T18:42:21.922171Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T18:42:21.922177Z info FLAG: --log_target="[stdout]" 2026-10-30T18:42:21.922180Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T18:42:21.922183Z info FLAG: --outlierLogPath="" 2026-10-30T18:42:21.922186Z info FLAG: --profiling="true" 2026-10-30T18:42:21.922189Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T18:42:21.922192Z info FLAG: --proxyLogLevel="warning" 2026-10-30T18:42:21.922195Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T18:42:21.922198Z info FLAG: --stsPort="0" 2026-10-30T18:42:21.922201Z info FLAG: --templateFile="" 2026-10-30T18:42:21.922203Z info FLAG: --tokenManagerPlugin="" 2026-10-30T18:42:21.922207Z info FLAG: --vklog="0" 2026-10-30T18:42:21.922211Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T18:42:21.922355Z info Proxy role ips=[10.132.0.58] type=router id=maas-default-gateway-openshift-default-855f9574cf-v8w6k.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T18:42:21.922400Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T18:42:21.924041Z info cpu limit detected as 2, setting concurrency 2026-10-30T18:42:21.924268Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T18:42:21.924279Z info JWT policy is third-party-jwt 2026-10-30T18:42:21.924282Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T18:42:21.926229Z info Starting default Istio SDS Server 2026-10-30T18:42:21.926259Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T18:42:21.926292Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T18:42:21.926863Z info Opening status port 15020 2026-10-30T18:42:21.927248Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T18:42:21.928263Z info sds Starting SDS grpc server 2026-10-30T18:42:21.928279Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T18:42:21.928631Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T18:42:21.929372Z info Starting proxy agent 2026-10-30T18:42:21.929400Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T18:42:21.993152Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T18:42:22.000999Z info cache generated new workload certificate resourceName=default latency=72.652086ms ttl=23h59m58.999003514s 2026-10-30T18:42:22.001027Z info cache Root cert has changed, start rotating root cert 2026-10-30T18:42:22.001054Z info cache returned workload trust anchor from cache ttl=23h59m58.998946908s 2026-10-30T18:42:22.091277Z info ads ADS: new connection for node:1 2026-10-30T18:42:22.091332Z info cache returned workload certificate from cache ttl=23h59m58.908669357s 2026-10-30T18:42:22.091683Z info ads ADS: new connection for node:2 2026-10-30T18:42:22.091751Z info cache returned workload trust anchor from cache ttl=23h59m58.908249682s 2026-10-30T18:42:22.175722Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:42:30.001207Z info Readiness succeeded in 8.081966998s 2026-10-30T18:42:30.001651Z info Envoy proxy is ready 2026-10-30T18:45:27.561606Z info ads ADS: new connection for node:3 2026-10-30T18:45:27.565311Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T18:45:27.565363Z info cache read certificate from file resource=file-root:system 2026-10-30T18:45:28.170714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:45:35.352713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:45:44.832245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:03.008836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:46:29.348453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:29.348490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:29.348501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:46:29.348506Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:46:29.348676Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T18:46:29.144Z] "POST /anything/e2e-rt-eq-1e8613-client HTTP/1.1" 200 - via_upstream - "-" 124 1772 204 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "be8483b1-06c3-4968-9984-68a0e2d7564e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.58:48710 10.132.0.58:443 10.132.0.19:54638 - llm.external-model-e2e-rt-eq-1e8613-4d38146b8aab.0 2026-10-30T18:46:57.422523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:47:02.606378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:47:02.663382Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T18:47:14.281023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:50:38.094Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 45 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "890b666d-0bd4-4e8c-adb3-cecf32adb940" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.58:443 10.132.0.19:41542 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:50:38.398997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:50:38.399044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:50:38.399065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:50:38.399072Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T18:50:38.330Z] "DELETE /v1/api-keys/afd69d67-199c-4745-a2d4-5c328125b9f4 HTTP/1.1" 200 - via_upstream - "-" 0 321 68 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "78b2e2ff-1ac6-46d8-9bb2-70b7ca91e56d" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:32998 10.132.0.58:443 10.132.0.19:41550 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:50:41.846374Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:50:41.846459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:50:41.846493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:50:41.846513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T18:50:41.717Z] "DELETE /v1/api-keys/1d53c5f4-b579-4fff-998e-72ddd6efb30d HTTP/1.1" 200 - via_upstream - "-" 0 321 128 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "a5f0a962-f708-4ad6-84ef-ee40c4b96b72" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.58:32998 10.132.0.58:443 10.132.0.19:41568 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:50:57.389Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 78 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "941e597c-8c24-4d2d-a758-13d6729875a5" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:52074 10.132.0.58:443 10.132.0.19:44144 - v1-completions-path 2026-10-30T18:52:59.789067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:53:59.883Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 226 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "c6a351f7-a63e-498e-b499-c4eff99d467e" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:52074 10.132.0.58:443 10.132.0.19:33110 - v1-chat-completions-path 2026-10-30T18:55:02.795476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:58:47.520847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T18:58:47.433Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 327 92 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "5328d295-31ba-44c3-8490-524caf9f4fbd" "maas.apps.3ad58fbeb6df127dd4c4.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.58:52074 10.132.0.58:443 10.132.0.19:57630 - v1-chat-completions-path 2026-10-30T19:05:19.817015Z info ads ADS: new connection for node:4 2026-10-30T19:05:19.860148Z info cache read certificate from file resource=file-root:system 2026-10-30T19:13:15.300763Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T19:13:31.282865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:13:47.904771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:14:25.634003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:18:59.435984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:19:01.610989Z info ads ADS: new connection for node:5 2026-10-30T19:19:01.611294Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T19:19:01.611398Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T19:19:04.703140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:19:07.847392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:19:09.524773Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:19:10.922872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:19:34.537421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:21:39.926127Z info ads ADS: "" 4 terminated 2026-10-30T19:22:29.233943Z info ads ADS: "" 5 terminated with stream closed 2026-10-30T19:25:21.171363Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3