2026-10-30T18:40:38.853529Z info FLAG: --concurrency="0" 2026-10-30T18:40:38.853547Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T18:40:38.853551Z info FLAG: --help="false" 2026-10-30T18:40:38.853553Z info FLAG: --log_as_json="false" 2026-10-30T18:40:38.853556Z info FLAG: --log_caller="" 2026-10-30T18:40:38.853557Z info FLAG: --log_output_level="default:info" 2026-10-30T18:40:38.853559Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T18:40:38.853563Z info FLAG: --log_target="[stdout]" 2026-10-30T18:40:38.853566Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T18:40:38.853567Z info FLAG: --outlierLogPath="" 2026-10-30T18:40:38.853569Z info FLAG: --profiling="true" 2026-10-30T18:40:38.853571Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T18:40:38.853573Z info FLAG: --proxyLogLevel="warning" 2026-10-30T18:40:38.853575Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T18:40:38.853579Z info FLAG: --stsPort="0" 2026-10-30T18:40:38.853581Z info FLAG: --templateFile="" 2026-10-30T18:40:38.853583Z info FLAG: --tokenManagerPlugin="" 2026-10-30T18:40:38.853592Z info FLAG: --vklog="0" 2026-10-30T18:40:38.853595Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T18:40:38.853727Z info Proxy role ips=[10.132.0.50] type=router id=maas-default-gateway-openshift-default-6dcf757899-6njrd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T18:40:38.853773Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T18:40:38.855245Z info cpu limit detected as 2, setting concurrency 2026-10-30T18:40:38.855487Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T18:40:38.855502Z info JWT policy is third-party-jwt 2026-10-30T18:40:38.855506Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T18:40:38.857164Z info Starting default Istio SDS Server 2026-10-30T18:40:38.857199Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T18:40:38.857224Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T18:40:38.857710Z info Opening status port 15020 2026-10-30T18:40:38.859025Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T18:40:38.859601Z info sds Starting SDS grpc server 2026-10-30T18:40:38.859638Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T18:40:38.860350Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T18:40:38.861107Z info Starting proxy agent 2026-10-30T18:40:38.861135Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T18:40:38.926369Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T18:40:38.988471Z info cache generated new workload certificate resourceName=default latency=128.726417ms ttl=23h59m59.011532555s 2026-10-30T18:40:38.988510Z info cache Root cert has changed, start rotating root cert 2026-10-30T18:40:38.988541Z info cache returned workload trust anchor from cache ttl=23h59m59.011460232s 2026-10-30T18:40:39.035302Z info ads ADS: new connection for node:1 2026-10-30T18:40:39.035358Z info cache returned workload certificate from cache ttl=23h59m58.964643658s 2026-10-30T18:40:39.036075Z info ads ADS: new connection for node:2 2026-10-30T18:40:39.036184Z info cache returned workload trust anchor from cache ttl=23h59m58.963817375s 2026-10-30T18:40:39.114030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:40:46.940658Z info Readiness succeeded in 8.08982743s 2026-10-30T18:40:46.940985Z info Envoy proxy is ready 2026-10-30T18:44:15.696117Z info ads ADS: new connection for node:3 2026-10-30T18:44:15.701585Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T18:44:15.701702Z info cache read certificate from file resource=file-root:system 2026-10-30T18:44:17.160697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:44:27.927364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:44:27.927405Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:44:27.927423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:44:27.927427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T18:44:27.813Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 842 113 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "2b587e26-969b-435e-a531-1738a6235b20" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "10.134.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.50:60350 10.132.0.50:443 10.132.0.13:46368 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:44:28.555737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:44:35.302247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:44:38.203Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 59 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "c21c3a3b-d2d0-4e72-8f4e-8cf9d865a2ba" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.50:443 10.132.0.13:44296 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:44:40.325799Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:44:40.325929Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:44:40.325975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:44:40.326002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:44:40.326335Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T18:44:39.938Z] "POST /llm/e2e-rt-sw-392a48/anything/e2e-rt-sw-392a48-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 388 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "1172bc6d-4ea8-4de8-9e86-8016996b7303" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-392a48.llm.svc.cluster.local - 10.132.0.50:443 10.132.0.13:44302 - llm.external-model-e2e-rt-sw-392a48-b0b17c73d33d.2 2026-10-30T18:44:45.980589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T18:44:53.597Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 52 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "b71dd495-f730-475d-9a13-9f60abee0eaf" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.50:443 10.132.0.13:51074 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:45:03.885Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 51 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "43586c01-97c3-45d7-ac4a-2e396a38cf26" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.50:443 10.132.0.13:34090 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:45:08.590948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:45:17.011643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:45:21.376814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.376853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.376867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:45:21.376873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T18:45:21.377070Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T18:45:21.246Z] "POST /anything/e2e-rt-eq-fccba7-client HTTP/1.1" 200 - via_upstream - "-" 124 1763 130 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "620624e6-2d6f-41aa-afa8-697228e334af" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.50:35466 10.132.0.50:443 10.132.0.13:41978 - llm.external-model-e2e-rt-eq-fccba7-bd2ccd20f88b.0 [2026-10-30T18:45:25.277Z] "GET /maas-api/v1/models HTTP/1.1" 403 - - "-" 0 0 51 - "34.228.250.194,10.132.0.13" "python-requests/2.34.2" "be2cdc73-0530-41d1-8534-79730c8c0c27" "maas.apps.02621b3ce4166c6b7f14.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.50:443 10.132.0.13:53844 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:45:39.251270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:45:47.173509Z info ads ADS: "" 3 terminated 2026-10-30T18:45:47.572350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:45:50.180081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T18:46:00.421437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9