2026-11-01T05:59:09.844966Z info FLAG: --concurrency="0" 2026-11-01T05:59:09.844986Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T05:59:09.844990Z info FLAG: --help="false" 2026-11-01T05:59:09.844992Z info FLAG: --log_as_json="false" 2026-11-01T05:59:09.844994Z info FLAG: --log_caller="" 2026-11-01T05:59:09.844996Z info FLAG: --log_output_level="default:info" 2026-11-01T05:59:09.844998Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T05:59:09.845003Z info FLAG: --log_target="[stdout]" 2026-11-01T05:59:09.845005Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T05:59:09.845007Z info FLAG: --outlierLogPath="" 2026-11-01T05:59:09.845009Z info FLAG: --profiling="true" 2026-11-01T05:59:09.845011Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T05:59:09.845014Z info FLAG: --proxyLogLevel="warning" 2026-11-01T05:59:09.845016Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T05:59:09.845018Z info FLAG: --stsPort="0" 2026-11-01T05:59:09.845020Z info FLAG: --templateFile="" 2026-11-01T05:59:09.845022Z info FLAG: --tokenManagerPlugin="" 2026-11-01T05:59:09.845025Z info FLAG: --vklog="0" 2026-11-01T05:59:09.845027Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T05:59:09.845168Z info Proxy role ips=[10.134.0.52] type=router id=maas-default-gateway-openshift-default-855f9574cf-6h48b.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T05:59:09.845217Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T05:59:09.846646Z info cpu limit detected as 2, setting concurrency 2026-11-01T05:59:09.846862Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T05:59:09.846874Z info JWT policy is third-party-jwt 2026-11-01T05:59:09.846878Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T05:59:09.848159Z info Starting default Istio SDS Server 2026-11-01T05:59:09.848182Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T05:59:09.848206Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T05:59:09.848680Z info Opening status port 15020 2026-11-01T05:59:09.849586Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T05:59:09.850103Z info sds Starting SDS grpc server 2026-11-01T05:59:09.850132Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T05:59:09.850904Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T05:59:09.851633Z info Starting proxy agent 2026-11-01T05:59:09.851663Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T05:59:09.913332Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T05:59:10.095971Z info cache generated new workload certificate resourceName=default latency=245.744374ms ttl=23h59m59.904035573s 2026-11-01T05:59:10.096033Z info cache Root cert has changed, start rotating root cert 2026-11-01T05:59:10.096071Z info cache returned workload trust anchor from cache ttl=23h59m59.903929528s 2026-11-01T05:59:10.108764Z info ads ADS: new connection for node:1 2026-11-01T05:59:10.108897Z info cache returned workload certificate from cache ttl=23h59m59.891115044s 2026-11-01T05:59:10.109534Z info ads ADS: new connection for node:2 2026-11-01T05:59:10.109633Z info cache returned workload trust anchor from cache ttl=23h59m59.890368247s 2026-11-01T05:59:10.202405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T05:59:18.410196Z info Readiness succeeded in 8.567575061s 2026-11-01T05:59:18.410560Z info Envoy proxy is ready [2026-11-01T06:01:37.626Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 45 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "7664f56f-72cd-4f13-bf97-292d12fa02f3" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.52:443 10.132.0.10:56058 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:04:41.788432Z info ads ADS: new connection for node:3 2026-11-01T06:04:41.801412Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:04:41.801463Z info cache read certificate from file resource=file-root:system [2026-11-01T06:06:40.476Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 96 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "143f77f0-d911-4f52-9670-3818ad68ca85" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:33864 10.134.0.52:443 10.132.0.10:43650 - v1-chat-completions-path 2026-11-01T06:06:54.846394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:06:54.846431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:06:54.846443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:06:54.846447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:06:54.846629Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-01T06:06:54.846677Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:06:54.846685Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:06:54.846688Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:06:54.846692Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T06:06:54.189Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 657 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "df4c5bd5-9c09-4816-929f-5efa563966da" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:40114 10.134.0.52:443 10.132.0.10:33848 - v1-chat-completions-path 2026-11-01T06:08:34.661024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:09:25.513747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:31.619971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:02.407375Z info ads ADS: new connection for node:4 2026-11-01T06:20:02.408085Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:20:02.408227Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:20:02.911992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:59.258418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:33.710898Z info ads ADS: "" 4 terminated 2026-11-01T06:26:11.195394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:26:24.734560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:00.755490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:37.059143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:43.764671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:47.019629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:53.390046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:57.359763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:00.480884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:13.744075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:17.432817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:33.334968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:25.702900Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T06:33:31.954821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:40.916928Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:54.767458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:19.702772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:24.030297Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:24.030335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:24.030348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:34:24.030353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:24.030564Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:34:23.902Z] "POST /anything/e2e-rt-sw-7b2206-client HTTP/1.1" 200 - via_upstream - "-" 124 1763 127 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "3744c722-4cc2-42c7-a481-ffbdd55bcfdc" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.52:59552 10.134.0.52:443 10.132.0.10:36468 - llm.external-model-e2e-rt-sw-7b2206-0a59c39ee4dc.0 2026-11-01T06:34:29.721127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:29.721160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:29.721170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:34:29.721174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:34:29.721319Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T06:34:29.664Z] "POST /llm/e2e-rt-sw-7b2206/anything/e2e-rt-sw-7b2206-client HTTP/1.1" 503 UH no_healthy_upstream - "-" 124 19 56 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "a8d49ed7-1b09-4867-ae15-8fa3ebcb4608" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-sw-7b2206.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:48518 - llm.external-model-e2e-rt-sw-7b2206-0a59c39ee4dc.2 2026-11-01T06:34:43.386540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:24.520473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:35:28.669Z] "POST /llm/e2e-rt-eq-a49015/anything/e2e-rt-eq-a49015-client HTTP/1.1" 503 - - "-" 124 0 67 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "a15f01b7-1ad4-400a-8b4f-6eb130d3a53e" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-a49015.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:33006 - llm.external-model-e2e-rt-eq-a49015-91904cc64c1f.4 [2026-11-01T06:36:39.955Z] "POST /llm/e2e-rt-eq-a49015/anything/e2e-rt-eq-a49015-client HTTP/1.1" 503 - - "-" 124 0 67 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "0e4cb465-9856-4658-9c4f-c3b23f939290" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-a49015.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:44660 - llm.external-model-e2e-rt-eq-a49015-91904cc64c1f.4 [2026-11-01T06:36:50.650Z] "POST /llm/e2e-rt-eq-a49015/anything/e2e-rt-eq-a49015-client HTTP/1.1" 503 - - "-" 124 0 103 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "7acfbc8a-0aa0-400e-8319-59965ddfe5d6" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rt-eq-a49015.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:39524 - llm.external-model-e2e-rt-eq-a49015-91904cc64c1f.4 2026-11-01T06:39:10.075327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:39:15.147284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:39:37.306067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:40:28.173535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:40:59.448747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:42:30.290316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:44:42.927559Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T06:47:48.398285Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-01T06:48:42.798162Z info ads ADS: new connection for node:5 2026-11-01T06:48:42.813200Z info cache read certificate from file resource=file-root:system 2026-11-01T06:50:54.959394Z info ads ADS: "" 5 terminated with stream closed 2026-11-01T06:56:45.141309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T06:56:45.253242Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:56:45.253276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:56:45.253290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:56:45.253295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:56:45.618133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:56:45.134Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 118 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "daf51d50-e2ed-46ea-b474-a4971a2d15bc" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:59084 10.134.0.52:443 10.132.0.10:40656 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:57:11.459579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:57:40.681459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:57:40.681493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:57:40.681505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:57:40.681509Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:57:40.569Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 112 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "55d17cd7-9ab9-433d-84bb-8ef581b89844" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:59084 10.134.0.52:443 10.132.0.10:47332 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:59:53.338686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:12.408248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:19.637911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:40.838982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:48.153693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:10.555039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:21.815775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:41.300701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:50.506539Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-01T07:01:52.429697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:03.505280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:14.257868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:25.033368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:45.732479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:56.670819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:07.399247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:18.178574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:05:45.496783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:04.651873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:09.396161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:11.910014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:06:11.910163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:06:11.910225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:06:11.910259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T07:06:10.091Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 1818 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "d74e6f29-e8c6-4912-9a7f-a68fb666e442" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:48138 10.134.0.52:443 10.132.0.10:55692 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:06:18.717611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:22.836289Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T07:06:22.758Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 77 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "8895fe05-b6ee-4e2e-8448-3480ac0e65eb" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:59124 10.134.0.52:443 10.132.0.10:34238 - v1-catch-all-path 2026-11-01T07:06:32.099485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:50.292388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:06.933586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:18.804274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:21.932320Z info ads ADS: new connection for node:6 2026-11-01T07:07:21.932512Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:21.932543Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:25.439118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:04.610699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:28.638609Z info ads ADS: "" 6 terminated 2026-11-01T07:08:28.685024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:33.309908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:44.837207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:09:17.263037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:09:47.588387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:15.180147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:46.019390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:01.271552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:18.915019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:30.702549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:35.602050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:11:38.730Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 77 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "87f9ab62-6e7f-4610-8b82-f4721cd11db7" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:35444 10.134.0.52:443 10.132.0.10:37958 - v1-completions-path 2026-11-01T07:11:55.107075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:49.261112Z info ads ADS: new connection for node:7 2026-11-01T07:12:49.265939Z info cache read certificate from file resource=file-root:system 2026-11-01T07:12:53.066946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:54.207289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:13:04.210267Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"1189","StreamId":"16584352764001826575"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-01T07:13:04.148Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "5a8323a0-f2a8-408f-b12f-578b75c056f2" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.52:443 10.132.0.10:53942 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T07:13:13.482608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:13.482640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:13.482650Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:13:13.482655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:13.482854Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T07:13:13.366Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 116 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "589a6fc5-2e5d-4d25-9ee9-073cdfbc9730" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.52:34054 10.134.0.52:443 10.132.0.10:42012 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:13:18.114164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:13:18.114196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:13:18.114205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:13:18.114209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T07:13:18.114401Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T07:13:18.004Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 109 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "39889e33-296a-4701-889a-3de67446190b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.52:34056 10.134.0.52:443 10.132.0.10:56514 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:13:57.566894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:57.566925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:57.566935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:13:57.566939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:57.567095Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T07:13:57.450Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 116 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "7c188f4d-f321-489b-b666-c976280a3825" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.52:34054 10.134.0.52:443 10.132.0.10:51368 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:14:46.116472Z info ads ADS: "" 7 terminated with stream closed 2026-11-01T07:14:46.157684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:48.753009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:58.884160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:31.068630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:54.328522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:16:05.935Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "4a212ded-bc74-498a-a2af-26e842015541" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:35444 10.134.0.52:443 10.132.0.10:48508 - v1-completions-path 2026-11-01T07:16:28.781142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:39.510373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:54.616282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:17:02.905Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "d533eaed-4b4a-4326-980e-8ce58e5414c8" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:35444 10.134.0.52:443 10.132.0.10:42296 - v1-completions-path 2026-11-01T07:17:18.066325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:30.201282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:39.436451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:17:48.169Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 71 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "f34625a4-d805-4dcb-868c-28b708a1f41c" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:34418 10.134.0.52:443 10.132.0.10:56950 - v1-completions-path 2026-11-01T07:17:52.445384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:01.796361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:10.876628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:20.134119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:18:23.290Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "b1750f90-2a26-4e04-b0a6-26754a46b936" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:34418 10.134.0.52:443 10.132.0.10:33486 - v1-completions-path 2026-11-01T07:18:36.905980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:48.169300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:28.099811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:56.593704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:07.462888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:04.809105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:09.566688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:17.968262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:27.363031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:57.761478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:02.710000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:22.438868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:33.261767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:39.612881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:08.622846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:14.853952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:20.888675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:26:28.587Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "f90d4b34-dfb8-4b89-b9f4-ee1c22d66ff5" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:57024 - v1-completions-path 2026-11-01T07:26:32.212387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-01T07:26:32.131Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 88 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "e799a067-2cb1-45fa-bca6-e001a48e3c48" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:52434 10.134.0.52:443 10.132.0.10:57034 - v1-completions-path [2026-11-01T07:26:35.719Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "46ab9f5f-26b0-4ea0-a988-8f00c783cba2" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.52:443 10.132.0.10:57062 - v1-completions-path 2026-11-01T07:26:49.984949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:10.709965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:17.260226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:23.411304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:32.826244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:27:39.450Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "a0c0a403-d3cd-49b8-b31a-095550f4dbac" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:52434 10.134.0.52:443 10.132.0.10:39826 - v1-completions-path [2026-11-01T07:27:39.822Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "c9a52dde-153f-4895-95f2-967d7b41a328" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:35444 10.134.0.52:443 10.132.0.10:39838 - v1-completions-path 2026-11-01T07:27:55.670054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:06.318090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:28:16.416Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 72 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "af91366d-7c88-423c-8e1f-89ce31cdba78" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.52:34418 10.134.0.52:443 10.132.0.10:45204 - v1-completions-path