2026-11-01T20:06:38.411734Z info FLAG: --concurrency="0" 2026-11-01T20:06:38.411763Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T20:06:38.411769Z info FLAG: --help="false" 2026-11-01T20:06:38.411772Z info FLAG: --log_as_json="false" 2026-11-01T20:06:38.411775Z info FLAG: --log_caller="" 2026-11-01T20:06:38.411777Z info FLAG: --log_output_level="default:info" 2026-11-01T20:06:38.411780Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T20:06:38.411786Z info FLAG: --log_target="[stdout]" 2026-11-01T20:06:38.411790Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T20:06:38.411793Z info FLAG: --outlierLogPath="" 2026-11-01T20:06:38.411796Z info FLAG: --profiling="true" 2026-11-01T20:06:38.411799Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T20:06:38.411802Z info FLAG: --proxyLogLevel="warning" 2026-11-01T20:06:38.411805Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T20:06:38.411808Z info FLAG: --stsPort="0" 2026-11-01T20:06:38.411811Z info FLAG: --templateFile="" 2026-11-01T20:06:38.411814Z info FLAG: --tokenManagerPlugin="" 2026-11-01T20:06:38.411817Z info FLAG: --vklog="0" 2026-11-01T20:06:38.411820Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T20:06:38.411990Z info Proxy role ips=[10.133.0.46] type=router id=maas-default-gateway-openshift-default-fd4b99879-fl2rn.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T20:06:38.412051Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T20:06:38.413221Z info cpu limit detected as 2, setting concurrency 2026-11-01T20:06:38.413496Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T20:06:38.413508Z info JWT policy is third-party-jwt 2026-11-01T20:06:38.413512Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T20:06:38.415622Z info Starting default Istio SDS Server 2026-11-01T20:06:38.415649Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T20:06:38.415672Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T20:06:38.415880Z info Opening status port 15020 2026-11-01T20:06:38.417398Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T20:06:38.418236Z info sds Starting SDS grpc server 2026-11-01T20:06:38.418265Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T20:06:38.419538Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T20:06:38.420554Z info Starting proxy agent 2026-11-01T20:06:38.420585Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T20:06:38.484090Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T20:06:38.547474Z info cache generated new workload certificate resourceName=default latency=129.054973ms ttl=23h59m59.452530797s 2026-11-01T20:06:38.547513Z info cache Root cert has changed, start rotating root cert 2026-11-01T20:06:38.547541Z info cache returned workload trust anchor from cache ttl=23h59m59.452459338s 2026-11-01T20:06:38.594886Z info ads ADS: new connection for node:1 2026-11-01T20:06:38.594951Z info cache returned workload certificate from cache ttl=23h59m59.405051604s 2026-11-01T20:06:38.595400Z info ads ADS: new connection for node:2 2026-11-01T20:06:38.595646Z info cache returned workload trust anchor from cache ttl=23h59m59.404355337s 2026-11-01T20:06:38.676900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:06:46.765280Z info Readiness succeeded in 8.356387809s 2026-11-01T20:06:46.765736Z info Envoy proxy is ready 2026-11-01T20:06:48.136914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:06:54.625930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:08:35.496502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:08:35.496538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:08:35.496551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:08:35.496556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T20:08:35.469Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 27 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "6a22c63e-6ec5-463f-8670-0bb0103452d0" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:43678 10.133.0.46:443 10.132.0.21:33076 - odh-ai-gateway-infra.maas-api-route.4 2026-11-01T20:08:35.805144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:08:35.805276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:08:35.805367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:08:35.805382Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:08:35.783Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 21 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "4c5e4662-34b5-4997-a281-9f30e99259bb" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:43678 10.133.0.46:443 10.132.0.21:33092 - odh-ai-gateway-infra.maas-api-route.4 2026-11-01T20:09:42.467602Z info ads ADS: new connection for node:3 2026-11-01T20:09:42.471075Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T20:09:42.471112Z info cache read certificate from file resource=file-root:system [2026-11-01T20:11:50.166Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 113 327 144 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "7c82975e-28b0-4c37-8678-8f5ca6142c73" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:49572 10.133.0.46:443 10.132.0.21:59340 - v1-chat-completions-path 2026-11-01T20:11:52.789829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:14:35.905572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:14:53.467544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:11.271686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:27.071793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:48.526776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:50.894301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:51.373027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:52.581523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:53.694126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:55.890478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:56.481232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:59.436798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:16:13.314902Z info ads ADS: new connection for node:4 2026-11-01T20:16:13.315061Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:16:13.315091Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:17:48.960055Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T20:18:09.910414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:19.973748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:39.657983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:54.474884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:19:17.542545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:19:23.475795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:19:23.475821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:19:23.475830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:19:23.475835Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:19:23.476007Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T20:19:23.314Z] "POST /anything/e2e-rt-sw-65ba84-client HTTP/1.1" 200 - via_upstream - "-" 124 1759 161 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "7b3bb4fa-df51-4cd8-b393-47cabc1ddd3c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:48938 10.133.0.46:443 10.132.0.21:45006 - llm.external-model-e2e-rt-sw-65ba84-0337161797d3.0 2026-11-01T20:19:39.423961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:19:40.010692Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:19:40.010824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:19:40.010882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:19:40.010916Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:19:39.855Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 155 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "cfe3fa32-fb38-4f81-ae4c-615bf379aa88" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:39148 10.133.0.46:443 10.132.0.21:57922 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:20:14.286663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:20:27.463326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:21:38.468598Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T20:21:51.767749Z info ads ADS: new connection for node:5 2026-11-01T20:21:51.773161Z info cache read certificate from file resource=file-root:system 2026-11-01T20:23:15.628225Z info ads ADS: "" 5 terminated 2026-11-01T20:25:37.305029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:25:41.201332Z info ads ADS: new connection for node:6 2026-11-01T20:25:41.208064Z info cache read certificate from file resource=file-root:system 2026-11-01T20:26:53.224549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:27:07.044067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:27:50.978448Z info ads ADS: "" 6 terminated with stream closed 2026-11-01T20:29:03.095506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:34:06.941927Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:34:06.941962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:34:06.941977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:34:06.941982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T20:34:06.866Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 75 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "98740938-0dfa-4638-96de-704c01cfafc1" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:41574 10.133.0.46:443 10.132.0.21:38616 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:34:36.278188Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T20:35:16.154976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:35:39.269634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:37:24.344108Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T20:37:24.344132Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T20:37:24.344136Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T20:37:24.344141Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-01T20:37:24.296Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 47 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "081e4077-0989-4091-927e-b50303f3ba87" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.21:35520 - v1-completions-path 2026-11-01T20:37:46.337203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:01.583346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:03.903344Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:12.823224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:17.893638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:35.120618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:54.914813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:05.102325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:15.499701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:25.594860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:35.900181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:46.099693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:56.344003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:06.511007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:16.934791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:26.938355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:41:52.471336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:41:56.747113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T20:41:55.907Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 166 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "3a259bc9-be8c-46c1-a66a-1b0fee5239ab" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:47370 10.133.0.46:443 10.132.0.21:58360 - v1-chat-completions-path [2026-11-01T20:41:56.740Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 59 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "3bf43c17-6b21-4e88-a5c0-c9e1cd108ef1" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.27:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:47374 10.133.0.46:443 10.132.0.21:58376 - v1-chat-completions-path 2026-11-01T20:42:08.167384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:09.707545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:15.619300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:30.906690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:32.345475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:46.535169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:57.528384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:59.415606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:59.443169Z info ads ADS: new connection for node:7 2026-11-01T20:42:59.449482Z info cache read certificate from file resource=file-root:system 2026-11-01T20:43:00.331310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:12.053426Z info ads ADS: "" 7 terminated with stream closed 2026-11-01T20:44:12.095607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:12.587856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:15.122714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:16.748625Z info ads ADS: new connection for node:8 2026-11-01T20:44:16.748886Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:44:18.637393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:59.078444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:45:04.109Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 88 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "52383b93-cf9c-4037-ae06-04cf3f38598b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.1.22:8000" outbound|54321||e2e-prio-pool-4cb35ada-inference-pool-ip-a775089e.llm.svc.cluster.local 10.133.0.46:58364 10.133.0.46:443 10.132.0.21:50682 - v1-model-routing [2026-11-01T20:45:16.570Z] "POST /v1/chat/completions HTTP/1.1" 403 - - "-" 131 0 34 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9ca4206d-a59c-4efb-b83a-a90e81bcbddd" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|54321||e2e-prio-pool-4cb35ada-inference-pool-ip-a775089e.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.21:36584 - v1-model-routing 2026-11-01T20:45:17.619754Z info ads ADS: "" 8 terminated with stream closed 2026-11-01T20:45:17.701234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:19.297008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:22.306556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:26.622770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:38.395955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:55.218037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:10.824237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:22.485995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:26.241159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:36.968018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:39.470170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:54.712948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:50:54.444340Z info ads ADS: new connection for node:9 2026-11-01T20:50:54.449790Z info cache read certificate from file resource=file-root:system 2026-11-01T20:50:54.920268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:50:56.368352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:51:01.950676Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"723","StreamId":"15700675830498490719"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-01T20:51:01.885Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 65 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "373330d7-3bc8-4e82-96d4-021a8344f571" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.46:443 10.132.0.21:41640 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T20:51:17.043889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:17.043917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:17.043926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:51:17.043930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:17.044068Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:51:16.915Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 129 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "d8feebe1-9f1c-4452-a3dc-c9fcacfa23b3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:43430 10.133.0.46:443 10.132.0.21:39454 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:51:27.994812Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:27.994846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:27.994857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:51:27.994861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:27.995014Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T20:51:27.864Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 130 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "c176c0ef-8e85-4d00-ab21-a1651aeef4fa" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:37998 10.133.0.46:443 10.132.0.21:33646 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:51:49.693088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:49.693124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:49.693135Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:49.693140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:51:49.693322Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T20:51:49.590Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 103 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "353cd47d-c48a-4be2-a543-79177e2f7ee9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:37998 10.133.0.46:443 10.132.0.21:36382 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:52:02.668703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T20:52:02.734961Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:02.734991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:02.735003Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:52:02.735007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:02.735178Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:52:02.604Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 131 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "026a9837-973a-4832-ac0a-fa12b248af28" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:43430 10.133.0.46:443 10.132.0.21:36350 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:52:04.900746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:04.900777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:04.900786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:04.900790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:52:04.900956Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:52:04.792Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1706 108 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "d517254a-75b1-4678-bdb0-029598ae4457" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.46:43430 10.133.0.46:443 10.132.0.21:36374 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:52:28.574557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:28.698828Z info ads ADS: "" 9 terminated with stream closed 2026-11-01T20:52:29.111383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:32.393915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:48.856066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:52.094024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:00.608784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:53:04.849Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 78 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "ef1addc6-c5b0-462c-88bb-ac0d7c508fed" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:36536 10.133.0.46:443 10.132.0.21:44812 - v1-completions-path 2026-11-01T20:53:21.925200Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:32.147307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:33.666013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:53:40.594Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "bee8569a-768a-4038-a53c-a0805f76628b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:35048 10.133.0.46:443 10.132.0.21:52982 - v1-completions-path 2026-11-01T20:53:52.529579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:54.016450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:59.324625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:10.206759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:23.868724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:25.292859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:30.755738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:49.011423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:51.600607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:05.500346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:06.998531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:55:10.064Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 36 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "7b444322-0610-463e-98ee-485ad8641d06" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.21:56042 - v1-completions-path 2026-11-01T20:55:12.332013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:55:15.653Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 76 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "60c83a9f-e039-4ec0-a4cd-faafd933406f" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:35048 10.133.0.46:443 10.132.0.21:56070 - v1-completions-path 2026-11-01T20:55:27.367776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:37.568913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:41.243651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:55:41.243688Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:55:41.243703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:55:41.243708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:55:41.180Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 63 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "bad16e0e-d50b-48cf-a1d7-98e838a55e0b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:44908 10.133.0.46:443 10.132.0.21:33778 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:55:52.623075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:55.079615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:59.384000Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T20:58:07.527415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:09.980838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:12.900529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:27.957709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:37.053043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:41.074385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:58:43.811Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "b7541580-27d5-4516-afba-3794d4a25b38" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:35048 10.133.0.46:443 10.132.0.21:38816 - v1-completions-path 2026-11-01T20:58:56.738493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:07.058795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:09.965272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:59:13.957Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "a616e9e7-398c-416d-a318-5f45726d38a3" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:35048 10.133.0.46:443 10.132.0.21:34172 - v1-completions-path [2026-11-01T20:59:14.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "7bf1d9f2-14ad-4494-a623-c7fe8b299b32" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:36536 10.133.0.46:443 10.132.0.21:34186 - v1-completions-path 2026-11-01T20:59:26.526907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:28.503164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:31.811973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:59:37.457Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "cbe075cc-a1d3-46c4-98d4-228c5e4e0729" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.21:37240 - v1-completions-path 2026-11-01T20:59:53.288207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:03.578807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:05.504000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:08.829468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T21:00:13.178Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "08292eab-01f9-4c62-868c-2fa650869b94" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:36536 10.133.0.46:443 10.132.0.21:49194 - v1-completions-path 2026-11-01T21:00:14.606621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:33.152198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:43.392888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T21:00:43.873Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 65 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9809b881-1041-47ed-951a-c8a09c96ea27" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:33222 10.133.0.46:443 10.132.0.21:43220 - v1-completions-path