2026-11-03T19:46:54.694371Z info FLAG: --concurrency="0" 2026-11-03T19:46:54.694390Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T19:46:54.694394Z info FLAG: --help="false" 2026-11-03T19:46:54.694396Z info FLAG: --log_as_json="false" 2026-11-03T19:46:54.694398Z info FLAG: --log_caller="" 2026-11-03T19:46:54.694400Z info FLAG: --log_output_level="default:info" 2026-11-03T19:46:54.694402Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T19:46:54.694464Z info FLAG: --log_target="[stdout]" 2026-11-03T19:46:54.694466Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T19:46:54.694468Z info FLAG: --outlierLogPath="" 2026-11-03T19:46:54.694470Z info FLAG: --profiling="true" 2026-11-03T19:46:54.694472Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T19:46:54.694474Z info FLAG: --proxyLogLevel="warning" 2026-11-03T19:46:54.694476Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T19:46:54.694491Z info FLAG: --stsPort="0" 2026-11-03T19:46:54.694494Z info FLAG: --templateFile="" 2026-11-03T19:46:54.694496Z info FLAG: --tokenManagerPlugin="" 2026-11-03T19:46:54.694498Z info FLAG: --vklog="0" 2026-11-03T19:46:54.694501Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T19:46:54.694641Z info Proxy role ips=[10.133.0.40] type=router id=maas-default-gateway-openshift-default-855f9574cf-g44hx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T19:46:54.694683Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T19:46:54.695664Z info cpu limit detected as 2, setting concurrency 2026-11-03T19:46:54.695923Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T19:46:54.695935Z info JWT policy is third-party-jwt 2026-11-03T19:46:54.695938Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T19:46:54.697747Z info Starting default Istio SDS Server 2026-11-03T19:46:54.697773Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T19:46:54.697796Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T19:46:54.698255Z info Opening status port 15020 2026-11-03T19:46:54.699286Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T19:46:54.700692Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T19:46:54.701576Z info Starting proxy agent 2026-11-03T19:46:54.701647Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T19:46:54.710825Z info sds Starting SDS grpc server 2026-11-03T19:46:54.710871Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T19:46:54.769369Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T19:46:54.817447Z info cache generated new workload certificate resourceName=default latency=118.386398ms ttl=23h59m59.182556255s 2026-11-03T19:46:54.817490Z info cache Root cert has changed, start rotating root cert 2026-11-03T19:46:54.817520Z info cache returned workload trust anchor from cache ttl=23h59m59.182479949s 2026-11-03T19:46:54.869931Z info ads ADS: new connection for node:1 2026-11-03T19:46:54.869988Z info cache returned workload certificate from cache ttl=23h59m59.130013413s 2026-11-03T19:46:54.870202Z info ads ADS: new connection for node:2 2026-11-03T19:46:54.870281Z info cache returned workload trust anchor from cache ttl=23h59m59.129719975s 2026-11-03T19:46:54.951444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:47:00.875234Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-03T19:47:02.847058Z info Readiness succeeded in 8.154908965s 2026-11-03T19:47:02.847505Z info Envoy proxy is ready 2026-11-03T19:49:46.001108Z info ads ADS: new connection for node:3 2026-11-03T19:49:46.007361Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T19:49:46.007411Z info cache read certificate from file resource=file-root:system 2026-11-03T19:49:46.601530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:49:57.054055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:00.165294Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:50:00.165332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:50:00.165345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:50:00.165350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T19:50:00.048Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 116 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "85f2292c-d257-4d39-b4d4-ec493b3c1713" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:45988 10.133.0.40:443 10.132.0.9:40090 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:50:07.915799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:29.982342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:50:57.993044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:06.616213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:13.130868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:51:13.130909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:51:13.130920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:51:13.130925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T19:51:13.131080Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-11-03T19:51:13.730623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:13.730650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:13.730659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:51:13.730663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:51:13.730807Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T19:51:12.973Z] "POST /anything/e2e-rt-eq-be9385-client HTTP/1.1" 200 - via_upstream - "-" 124 1575 157 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "71a09251-f86a-4a81-96c1-cd575473581e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:47984 10.133.0.40:443 10.132.0.9:40094 - llm.external-model-e2e-rt-eq-be9385-b6430985953f.2 [2026-11-03T19:51:13.578Z] "POST /anything/e2e-rt-eq-be9385-client HTTP/1.1" 200 - via_upstream - "-" 124 1583 152 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d55068e2-d5da-46bc-8201-f7b48197eb35" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:47992 10.133.0.40:443 10.132.0.9:40110 - llm.external-model-e2e-rt-eq-be9385-b6430985953f.0 2026-11-03T19:51:33.387257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:38.799005Z info ads ADS: "" 3 terminated 2026-11-03T19:51:38.888817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:51:48.812321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:52:37.947106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:52:53.783689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:53:13.337927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:54:47.322857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T19:55:18.450395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:18.450429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:18.450442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T19:55:18.450447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T19:55:18.386Z] "DELETE /v1/api-keys/f0211d5e-06f1-40fc-87fa-0180a58039ce HTTP/1.1" 200 - via_upstream - "-" 0 370 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "55596272-a786-4185-938b-73f3a9aca08b" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:59718 10.133.0.40:443 10.132.0.9:33244 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:20.362346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:20.362390Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:20.362408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:55:20.362415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T19:55:20.303Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 59 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "63a091c5-4c6b-45fa-820a-9854b0b8cad7" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:59720 10.133.0.40:443 10.132.0.9:33260 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:21.615465Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:21.615607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:21.615651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T19:55:21.615663Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T19:55:21.562Z] "DELETE /v1/api-keys/2bd1762b-e195-4bd6-b21d-c1b5febfa98a HTTP/1.1" 200 - via_upstream - "-" 0 321 53 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "faf4dec7-9299-4941-88c4-db467737c57f" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:59720 10.133.0.40:443 10.132.0.9:33268 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T19:55:38.889314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:38.889350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:38.889364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T19:55:38.889370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T19:55:38.831Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 57 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "89aa2f86-b3ad-4d75-bfcf-d2b8f2b7eb1e" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:59720 10.133.0.40:443 10.132.0.9:41948 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:09:46.379075Z info ads ADS: new connection for node:4 2026-11-03T20:09:46.386286Z info cache read certificate from file resource=file-root:system 2026-11-03T20:15:45.718125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:16:15.227110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:16:25.032456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:16:25.032504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:16:25.032515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:16:25.032520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:16:25.032698Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T20:16:24.774Z] "POST /anything/e2e-dft-f2d751-a20dea HTTP/1.1" 200 - via_upstream - "-" 109 1595 257 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9b50cd97-637a-4cef-ac5a-25146a5abc22" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:36834 10.133.0.40:443 10.132.0.9:51800 - llm.external-model-e2e-dft-f2d751-e6f7100f08a8.0 2026-11-03T20:16:57.452962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:17:35.932014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:26.523753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:45.021352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:51.464610Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:19:43.268621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:20:40.509045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:20:44.375921Z info ads ADS: new connection for node:5 2026-11-03T20:20:44.376135Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:20:44.376170Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:21:27.879917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:22:29.490500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:22:51.486212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:23:39.502253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:24:58.469225Z info ads ADS: "" 5 terminated 2026-11-03T20:28:08.901977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:28:23.134958Z info ads ADS: "" 4 terminated with stream closed 2026-11-03T20:30:20.995977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:30:55.098934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:31:21.864368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:33:14.500128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:34:53.073241Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-03T20:42:14.083015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T20:42:14.088366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:14.088406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:14.088423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:42:14.088428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:14.267770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:42:14.006Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 81 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "b7ae86e3-95b6-4b70-9255-1c97a1305bbc" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:38100 10.133.0.40:443 10.133.1.17:58444 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:42:37.594445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:42:49.883985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:49.884017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:49.884028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:42:49.884033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:42:49.828Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 55 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "177d7e82-29fd-44d6-97b7-cc29a96c9f3e" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:38100 10.133.0.40:443 10.133.1.17:35686 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:43:11.467455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:15.848537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:26.328954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:43:29.189Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 147 412 132 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "a5855e3d-1de0-4990-bacc-7849896121a4" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.115:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:50892 10.133.0.40:443 10.133.1.17:44792 - v1-chat-completions-path 2026-11-03T20:43:42.316997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:43.961050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:43:49.495169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:04.713222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:06.379886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:30.225537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:41.038032Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:44:43.623130Z info ads ADS: new connection for node:6 2026-11-03T20:44:43.623727Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:44:43.623915Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T20:44:45.271959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:25.196939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:44.415496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:44.978373Z info ads ADS: "" 6 terminated 2026-11-03T20:45:46.264234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:45:57.578127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:46:08.962398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:21.683583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:48:39.111206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:03.300004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T20:49:03.303335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:03.303367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:03.303382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:49:03.303387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:49:03.248Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 55 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "ea5b345b-b66b-47e9-bb22-087fafbc1e9c" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.133.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:60978 10.133.0.40:443 10.133.1.17:46786 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:49:04.732727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:16.318680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:19.688110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:28.746528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:30.933940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:46.427881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:49:48.030Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 86 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "d56af904-4011-4c53-b024-bd6acd9429f2" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:51522 10.133.0.40:443 10.133.1.17:48852 - v1-completions-path 2026-11-03T20:50:04.058106Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T20:50:30.911872Z info ads ADS: new connection for node:7 2026-11-03T20:50:30.916641Z info cache read certificate from file resource=file-root:system 2026-11-03T20:50:31.439464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:33.090425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:51:02.283194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:02.283234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:02.283250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:02.283265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:51:02.283520Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T20:51:02.151Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1528 132 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "1f4df9d6-0e83-466d-831e-da0196eb8265" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:44082 10.133.0.40:443 10.133.1.17:58534 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T20:51:08.772678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:08.772712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:08.772724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:51:08.772728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:51:08.772900Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T20:51:08.678Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1534 94 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "f043a820-ea88-41d3-8850-9fe794c8c64e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:44082 10.133.0.40:443 10.133.1.17:36138 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T20:51:37.347000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:37.347044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:37.347064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:51:37.347070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:51:37.347316Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-03T20:51:37.216Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1535 131 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "3c263bf7-ebfe-4ef2-94b9-514e5034d2b2" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.40:56468 10.133.0.40:443 10.133.1.17:37512 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T20:52:17.854800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:18.077965Z info ads ADS: "" 7 terminated 2026-11-03T20:52:18.539417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:21.313344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:23.075835Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:39.957321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:52:51.208039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:06.557275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:08.329648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:11.024097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:19.380089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:53:24.056Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 82 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "bcf8077a-90bb-4394-a648-1ba8e189922b" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:47080 10.133.0.40:443 10.133.1.17:40066 - v1-completions-path [2026-11-03T20:53:24.765Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "f6518c19-6148-4ace-96ee-81845ae93c1c" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:47080 10.133.0.40:443 10.133.1.17:40076 - v1-completions-path 2026-11-03T20:53:40.883443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:51.036743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:02.768940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:19.299105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:20.922566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:35.976684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:38.120557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:44.011143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:52.426415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:06.205478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:36.823974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:39.399764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:55:42.307Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 86 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "35e167d5-b1ea-4df5-86f4-5d95f09e6d4a" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:51522 10.133.0.40:443 10.133.1.17:60962 - v1-completions-path 2026-11-03T20:56:04.730088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:06.894633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:11.174575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:36.462883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:56.670214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:12.978150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:15.620462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:25.307932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:35.017888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:04.360558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:01:04.842Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 175 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "d240d148-6d8e-4067-b934-a6a732a08da7" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:54028 10.133.0.40:443 10.133.1.17:44164 - v1-completions-path 2026-11-03T21:01:18.542978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:20.282826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:23.419811Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:01:23.419836Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:01:23.419840Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T21:01:23.419844Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T21:01:23.374Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 45 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "60afda85-c0c9-49c5-bcb6-701e801bd2aa" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 10.133.1.17:51440 - v1-completions-path 2026-11-03T21:01:25.660255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:54.540670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:01:58.546920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:02:00.804Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 127 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "8031b80a-a5d2-463c-bb74-6f78f4604b34" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:47080 10.133.0.40:443 10.133.1.17:52134 - v1-completions-path 2026-11-03T21:02:14.737004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:35.008723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:38.062638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:02:42.691Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 72 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "7d1c6edc-d3df-4398-a425-1e8096b90cf7" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:47080 10.133.0.40:443 10.133.1.17:40770 - v1-completions-path 2026-11-03T21:02:54.807109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:02:56.894039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:00.006641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:03:03.875Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 69 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "d568fb27-3a2b-4b63-bc78-d39e5bef30a3" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:47080 10.133.0.40:443 10.133.1.17:52482 - v1-completions-path [2026-11-03T21:03:05.927Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 70 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "5b5b6ac1-9976-42ea-8d78-277594a2e2d5" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.89:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.40:38624 10.133.0.40:443 10.133.1.17:56492 - v1-completions-path 2026-11-03T21:03:20.991537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:31.203195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:33.393961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:36.325571Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:03:41.564942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:03:46.678Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "70142878-b25c-4910-af11-5ebe581b26cc" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.40:443 10.133.1.17:34326 - v1-completions-path 2026-11-03T21:03:58.352825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:08.607603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:10.254443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:17.142050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:20.142791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:23.454268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:39.315216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:04:59.255517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:09.447598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:19.733673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:29.847626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:40.066055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:50.251910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:00.454833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:10.630355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:20.837058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:31.118286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:42.049127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:06:42.049163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:06:42.049176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:06:42.049181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T21:06:41.977Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 71 - "44.212.242.249,10.133.1.17" "python-requests/2.34.2" "968b56e7-60d1-4c90-a25c-6a51ee350bd5" "maas.apps.00125a180bb08b60980b.prod.konflux-ocp-ci.dev" "10.132.1.216:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.40:56672 10.133.0.40:443 10.133.1.17:46732 - odh-ai-gateway-infra.maas-api-route.3