2026-10-30T07:48:22.108026Z info FLAG: --concurrency="0" 2026-10-30T07:48:22.108044Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T07:48:22.108048Z info FLAG: --help="false" 2026-10-30T07:48:22.108050Z info FLAG: --log_as_json="false" 2026-10-30T07:48:22.108052Z info FLAG: --log_caller="" 2026-10-30T07:48:22.108054Z info FLAG: --log_output_level="default:info" 2026-10-30T07:48:22.108056Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T07:48:22.108061Z info FLAG: --log_target="[stdout]" 2026-10-30T07:48:22.108063Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T07:48:22.108065Z info FLAG: --outlierLogPath="" 2026-10-30T07:48:22.108067Z info FLAG: --profiling="true" 2026-10-30T07:48:22.108069Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T07:48:22.108071Z info FLAG: --proxyLogLevel="warning" 2026-10-30T07:48:22.108073Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T07:48:22.108075Z info FLAG: --stsPort="0" 2026-10-30T07:48:22.108077Z info FLAG: --templateFile="" 2026-10-30T07:48:22.108079Z info FLAG: --tokenManagerPlugin="" 2026-10-30T07:48:22.108081Z info FLAG: --vklog="0" 2026-10-30T07:48:22.108084Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T07:48:22.108217Z info Proxy role ips=[10.134.1.12] type=router id=maas-default-gateway-openshift-default-59f957fdd7-z6h7r.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T07:48:22.108265Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T07:48:22.109699Z info cpu limit detected as 2, setting concurrency 2026-10-30T07:48:22.109913Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T07:48:22.109923Z info JWT policy is third-party-jwt 2026-10-30T07:48:22.109926Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T07:48:22.111390Z info Starting default Istio SDS Server 2026-10-30T07:48:22.111412Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T07:48:22.111435Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T07:48:22.112104Z info Opening status port 15020 2026-10-30T07:48:22.112479Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T07:48:22.113862Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T07:48:22.114698Z info Starting proxy agent 2026-10-30T07:48:22.114730Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T07:48:22.124515Z info sds Starting SDS grpc server 2026-10-30T07:48:22.124534Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T07:48:22.176572Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T07:48:22.193126Z info cache generated new workload certificate resourceName=default latency=80.741056ms ttl=23h59m59.806876851s 2026-10-30T07:48:22.193157Z info cache Root cert has changed, start rotating root cert 2026-10-30T07:48:22.193186Z info cache returned workload trust anchor from cache ttl=23h59m59.806814611s 2026-10-30T07:48:22.284580Z info ads ADS: new connection for node:1 2026-10-30T07:48:22.284636Z info cache returned workload certificate from cache ttl=23h59m59.715366237s 2026-10-30T07:48:22.284775Z info ads ADS: new connection for node:2 2026-10-30T07:48:22.284843Z info cache returned workload trust anchor from cache ttl=23h59m59.715158617s 2026-10-30T07:48:22.367026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:48:30.266966Z info Readiness succeeded in 8.161138208s 2026-10-30T07:48:30.267287Z info Envoy proxy is ready 2026-10-30T07:48:37.079664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:48:39.308037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:48:53.900064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:49:05.121486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:49:07.758935Z info ads ADS: new connection for node:3 2026-10-30T07:49:07.759109Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:07.759133Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:08.766477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:49:49.503784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:49:54.750Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 329 96 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f6bb9a37-46f9-4b75-990f-b53fa0903ab8" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.1.13:8000" outbound|54321||e2e-prio-pool-0fdfdccb-inference-pool-ip-2d07c08b.llm.svc.cluster.local 10.134.1.12:33916 10.134.1.12:443 10.132.0.10:38274 - v1-model-routing 2026-10-30T07:50:08.352447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:50:08.486102Z info ads ADS: "" 3 terminated 2026-10-30T07:50:10.724980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:50:13.426812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:50:18.366308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:51:53.733370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:52:10.682738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:52:26.304926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:52:38.184066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:52:44.440444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.440482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.440515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:52:44.440521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:52:44.554572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:52:44.354Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 86 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "001d2f3f-a43d-4725-8ad2-8821570e04d8" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.12:45040 10.134.1.12:443 10.132.0.10:53636 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:52:56.407905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:53:00.957043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:53:07.144534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:07.144576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:07.144593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:53:07.144598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:53:07.077Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 67 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d834fd53-61be-4512-99e1-3592c26b4c29" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.12:37798 10.134.1.12:443 10.132.0.10:44538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:53:19.069004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:54:05.401824Z info ads ADS: new connection for node:4 2026-10-30T07:54:05.411582Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:54:05.411635Z info cache read certificate from file resource=file-root:system 2026-10-30T07:54:06.654834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:54:07.792404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:54:21.116824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:21.116861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:21.116876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:21.116882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:21.117067Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:21.006Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1719 110 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "8461e00d-188d-4786-bb5a-3903b1761c49" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:45708 10.134.1.12:443 10.132.0.10:60352 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:54:33.916878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:33.916917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:33.916931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:54:33.916937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:33.917117Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:54:33.805Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 111 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "c24564fe-c1b0-4f3f-b3c6-4c3d5d98c905" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:40500 10.134.1.12:443 10.132.0.10:35356 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:54:53.031636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T07:54:53.032073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:53.032098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:53.032108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:54:53.032112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:54:53.032252Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:54:52.932Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 100 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "266c1f3c-b7ab-9835-992e-4f9acf5ac17b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:40500 10.134.1.12:443 10.132.0.10:45734 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:16.454532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:16.454573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:16.454588Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:16.454593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:16.454785Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:55:16.357Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 97 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "153a961c-5709-4308-bf1c-5e4e5ce63921" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:40500 10.134.1.12:443 10.132.0.10:43646 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:25.053836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:25.053868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:25.053879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:25.053883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:55:25.054047Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:55:24.949Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1730 104 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6a13d00f-5169-46e1-9c11-e7901a194e52" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:45708 10.134.1.12:443 10.132.0.10:33314 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:27.168756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:27.168795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:27.168811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:27.168817Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:27.169008Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:55:27.077Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1733 91 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d9276a35-d55b-4710-95e9-9cc210eecd9d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.12:40500 10.134.1.12:443 10.132.0.10:33340 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:51.166505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:55:51.279068Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T07:55:51.754699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:55:54.716218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:55:59.572091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:56:07.440Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d39bb6e3-870a-4a5a-9bc7-8ce1ea2ac06f" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.12:443 10.132.0.10:47526 - v1-completions-path 2026-10-30T07:56:19.360460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:56:23.501192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:56:27.208Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "ae1a993e-90f9-4de1-83c9-591727e085ad" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.12:443 10.132.0.10:59682 - v1-completions-path 2026-10-30T07:56:39.195479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:56:55.046201Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:57:00.455127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T07:57:00.237Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 72 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "05e4f403-f68d-4594-9c9a-6a5f5fa6a205" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:42946 - v1-completions-path [2026-10-30T07:57:00.402Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "67d74e86-3fd2-47ca-97da-6fae2d5f47d1" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46956 10.134.1.12:443 10.132.0.10:52828 - v1-completions-path [2026-10-30T07:57:00.788Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "159915a4-4fa6-4e6c-811f-b09f9862bfa4" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:52842 - v1-completions-path [2026-10-30T07:57:00.865Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 55 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e76a1ca0-941a-48f8-84a0-689f6afd6763" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46956 10.134.1.12:443 10.132.0.10:52844 - v1-completions-path [2026-10-30T07:57:01.274Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 83 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9828abf2-5e2b-4d4f-b9c5-e5124fcd911d" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46956 10.134.1.12:443 10.132.0.10:52856 - v1-completions-path [2026-10-30T07:57:01.383Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 75 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "efbdcd6e-1492-46a1-b346-a310e80351f8" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:52860 - v1-completions-path 2026-10-30T07:57:17.381294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:57:27.700711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:57:31.871356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:57:36.553Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "aa33fbf9-1ff5-4ab8-ae53-cfdb9b7b998b" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:33812 - v1-completions-path 2026-10-30T07:57:49.131811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:57:51.350789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:58:10.654489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:58:15.554876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:58:30.905914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:58:33.080645Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:58:49.763Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "05f83c6e-454c-48e0-835a-55526f017c64" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:33688 10.134.1.12:443 10.132.0.10:60994 - v1-completions-path 2026-10-30T07:58:50.878484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:59:01.692687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T07:59:04.513379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:59:25.891Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "735f9c78-2ed4-4724-8acb-f11d4f1c8ede" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.12:443 10.132.0.10:58736 - v1-completions-path 2026-10-30T07:59:32.647130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T07:59:38.438Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 305 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "70b9b85c-43d7-4806-8d7a-a6f9141dfc50" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46956 10.134.1.12:443 10.132.0.10:50538 - v1-completions-path 2026-10-30T07:59:50.653178Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:00:01.010625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:03:28.680325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:03:43.877516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:03:46.109318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:05.236124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:17.332333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:20.884730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:36.991432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:47.462132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:04:52.328235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:09.339457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:14.261934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:17.089556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:23.254531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:05:23.254567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:05:23.254582Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T08:05:23.254587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T08:05:23.174Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 79 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "fd349099-c656-4a46-b602-5373297ec355" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.1.23:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.12:36668 10.134.1.12:443 10.132.0.10:43260 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T08:05:26.066Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "4bea52ae-a0ed-4274-819b-e3e9c759da78" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:43264 - v1-completions-path [2026-10-30T08:05:26.250Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b4ddc223-1211-40de-b3c8-1abe4f634ad0" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:43268 - v1-completions-path [2026-10-30T08:05:26.960Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "3e6d1e9e-ef34-412a-b66d-a471ad896a17" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46956 10.134.1.12:443 10.132.0.10:43294 - v1-completions-path [2026-10-30T08:05:27.325Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "5721d738-e695-423d-95fa-20bf583ee481" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:43306 - v1-completions-path [2026-10-30T08:05:27.505Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d9f770fe-8ca7-4fca-a78e-235dcecf4ba4" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:46944 10.134.1.12:443 10.132.0.10:43314 - v1-completions-path 2026-10-30T08:05:40.138900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:50.463612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:54.883992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:05:57.604030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:01.268160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:18.606641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:28.935257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:31.338235Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:40.969984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:06:46.159154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:07:02.831269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:07:22.973549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:07:33.407650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:07:43.846931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:07:54.385248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:04.643166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:15.001314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:25.403751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:35.767271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:46.153800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:08:56.461624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T08:09:01.264448Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T08:09:01.264474Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T08:09:01.264477Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T08:09:01.264481Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T08:09:01.240Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 24 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f535067a-03f7-4fb9-9ba5-c63b8c969d54" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.12:443 10.132.0.10:53020 - v1-completions-path [2026-10-30T08:09:03.476Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 72 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d3c66f8a-57ff-4bac-9425-c623d5d20a10" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.12:48660 10.134.1.12:443 10.132.0.10:53030 - v1-completions-path