2026-10-30T04:12:12.996288Z info FLAG: --concurrency="0" 2026-10-30T04:12:12.996377Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T04:12:12.996382Z info FLAG: --help="false" 2026-10-30T04:12:12.996386Z info FLAG: --log_as_json="false" 2026-10-30T04:12:12.996389Z info FLAG: --log_caller="" 2026-10-30T04:12:12.996393Z info FLAG: --log_output_level="default:info" 2026-10-30T04:12:12.996396Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T04:12:12.996403Z info FLAG: --log_target="[stdout]" 2026-10-30T04:12:12.996406Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T04:12:12.996410Z info FLAG: --outlierLogPath="" 2026-10-30T04:12:12.996413Z info FLAG: --profiling="true" 2026-10-30T04:12:12.996416Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T04:12:12.996419Z info FLAG: --proxyLogLevel="warning" 2026-10-30T04:12:12.996423Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T04:12:12.996426Z info FLAG: --stsPort="0" 2026-10-30T04:12:12.996429Z info FLAG: --templateFile="" 2026-10-30T04:12:12.996432Z info FLAG: --tokenManagerPlugin="" 2026-10-30T04:12:12.996437Z info FLAG: --vklog="0" 2026-10-30T04:12:12.996441Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T04:12:12.996632Z info Proxy role ips=[10.134.0.247] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-bp56d.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T04:12:12.996699Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T04:12:12.998661Z info cpu limit detected as 2, setting concurrency 2026-10-30T04:12:12.999010Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T04:12:12.999026Z info JWT policy is third-party-jwt 2026-10-30T04:12:12.999031Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T04:12:13.000729Z info Starting default Istio SDS Server 2026-10-30T04:12:13.000780Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T04:12:13.000799Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T04:12:13.001026Z info Opening status port 15020 2026-10-30T04:12:13.001929Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T04:12:13.002985Z info sds Starting SDS grpc server 2026-10-30T04:12:13.003006Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T04:12:13.003437Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T04:12:13.004621Z info Starting proxy agent 2026-10-30T04:12:13.004661Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T04:12:13.102166Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T04:12:13.138517Z info cache generated new workload certificate resourceName=default latency=135.425514ms ttl=23h59m59.861487153s 2026-10-30T04:12:13.138556Z info cache Root cert has changed, start rotating root cert 2026-10-30T04:12:13.138585Z info cache returned workload trust anchor from cache ttl=23h59m59.86141589s 2026-10-30T04:12:13.248355Z info ads ADS: new connection for node:1 2026-10-30T04:12:13.248418Z info cache returned workload certificate from cache ttl=23h59m59.751583597s 2026-10-30T04:12:13.249272Z info ads ADS: new connection for node:2 2026-10-30T04:12:13.249356Z info cache returned workload trust anchor from cache ttl=23h59m59.750645284s 2026-10-30T04:12:13.332653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:17.756311Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-10-30T04:12:21.634164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:12:22.595483Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T04:12:24.128141Z info Readiness succeeded in 11.135426569s 2026-10-30T04:12:24.128579Z info Envoy proxy is ready 2026-10-30T04:12:54.928464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:12:57.807Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 89 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "ae42b6e4-9739-4073-93ae-5b1bccc95fe5" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:46496 10.134.0.247:443 10.133.0.13:55966 - v1-chat-completions-path 2026-10-30T04:13:10.685734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:13.244279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:19.739738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:22.567146Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 2026-10-30T04:13:22.746287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T04:13:22.747416Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T04:13:22.476Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 90 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "62ad6959-46a2-402b-83cf-05a35ea3ce41" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.51:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:39228 10.134.0.247:443 10.133.0.13:32980 - v1-catch-all-path [2026-10-30T04:13:22.686Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 60 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "dabc0775-1959-460e-ba08-2c9bd7b238a1" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.51:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:39228 10.134.0.247:443 10.133.0.13:32984 - v1-catch-all-path 2026-10-30T04:13:27.264631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:36.501553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:13:51.215577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:02.174320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:04.032868Z info ads ADS: new connection for node:3 2026-10-30T04:14:04.033075Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:14:04.033107Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:14:06.063419Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:14:46.856047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:14:51.600Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 346 87 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "1a4db41d-3026-4873-ae20-acfc7761f747" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.1.90:8000" outbound|54321||e2e-prio-pool-f2b786ee-inference-pool-ip-19c7a697.llm.svc.cluster.local 10.134.0.247:37222 10.134.0.247:443 10.133.0.13:41774 - v1-model-routing 2026-10-30T04:15:05.704577Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T04:15:05.786098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:09.351179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:15:17.437971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:16:45.041828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:01.365157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:17.497437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:29.361864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:33.385575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:44.430589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:17:47.984991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:17:50.824Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 70 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "18a89387-7c29-4d1a-97ab-66432264ef6f" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:52322 10.134.0.247:443 10.133.0.13:38366 - v1-completions-path 2026-10-30T04:18:03.025249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:18:50.191826Z info ads ADS: new connection for node:4 2026-10-30T04:18:50.195994Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:18:50.196040Z info cache read certificate from file resource=file-root:system 2026-10-30T04:18:51.263429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:18:52.924217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:19:51.010497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:51.010533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:51.010547Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:51.010551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:19:51.010723Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:19:50.898Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1728 112 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "e9192a33-821b-485f-b7b2-0f78161ecd51" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.247:44104 10.134.0.247:443 10.133.0.13:38650 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:20:25.140001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:25.140032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:25.140041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:25.140045Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:20:25.140189Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:20:25.027Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 112 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "e655a2ae-3427-4c48-aa3c-570f84f14036" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.247:56792 10.134.0.247:443 10.133.0.13:38736 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:20:40.565155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:20:40.693655Z info ads ADS: "" 4 terminated 2026-10-30T04:20:42.067491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:20:48.776335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:21:04.543947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:21:09.327340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:21:26.201624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:21:40.456502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:21:48.401Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "b0c9d657-6b39-4013-80ca-38b633c9e3d3" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:45622 - v1-completions-path 2026-10-30T04:22:03.912508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:14.139991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:18.924995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:36.058814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:38.410998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:45.747955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:22:57.561726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:23:02.881001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:23:11.033302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:23:16.366847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:23:34.686153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:23:37.762163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:23:40.405Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 82 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "085d69df-cb5a-419e-a277-c7ecde4fa102" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:46056 10.134.0.247:443 10.133.0.13:52124 - v1-completions-path 2026-10-30T04:23:53.262277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:23:55.123Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 62 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "f497be0b-958b-4bfa-92b9-112383014225" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.247:443 10.133.0.13:49092 - v1-completions-path 2026-10-30T04:23:56.189836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:24:04.260979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:24:22.223273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:24:32.592483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:24:49.960562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:24:53.465215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:26:24.608970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:26:28.047118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:27:53.217523Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:08.555063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:10.926553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:18.125681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:38.351225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:41.428873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:28:44.126035Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T04:28:44.049Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 80 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "ac0be1fa-83a1-4c01-89cf-00e1d4caf155" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:39046 - v1-completions-path 2026-10-30T04:28:57.009478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:29:07.337114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:29:12.508019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:29:18.080794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:29:18.080829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:29:18.080844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:29:18.080849Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:29:18.003Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 77 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "9a3ceae0-422f-4da4-bb12-99460d3b4989" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.1.124:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.247:58366 10.134.0.247:443 10.133.0.13:50196 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:29:31.238894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:29:35.884242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:29:38.753799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:29:46.928Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "19edfc48-b378-4924-9a21-d4d798e3b49a" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:59998 - v1-completions-path [2026-10-30T04:29:48.244Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "89521d3e-c31c-9a65-9c69-625a94d39301" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:52322 10.134.0.247:443 10.133.0.13:60012 - v1-completions-path [2026-10-30T04:29:48.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "3c5c754f-b4da-4bbd-993f-ec8611392d7a" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:60016 - v1-completions-path [2026-10-30T04:29:49.337Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "fc762ac5-92d2-44da-9876-084dc2a34ecb" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:60028 - v1-completions-path [2026-10-30T04:29:49.702Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 52 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "69954536-f60f-4e33-a954-20ded0265ee2" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.247:443 10.133.0.13:60036 - v1-completions-path 2026-10-30T04:30:01.867276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:12.238981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:14.719226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:17.659583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:22.861224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:30:28.102Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "003159fd-c55a-4fd3-a555-947c182ee763" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:57508 10.134.0.247:443 10.133.0.13:44950 - v1-completions-path [2026-10-30T04:30:28.481Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "51cc8f82-f0ac-43e4-be6c-e0abe6dbf3ce" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:52322 10.134.0.247:443 10.133.0.13:44964 - v1-completions-path 2026-10-30T04:30:41.135368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:51.484391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:30:53.948045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:31:03.700885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:31:08.571868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:31:25.369116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:31:45.258402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:31:55.552808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:05.904220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:16.316313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:26.588086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:36.954624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:47.301875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:32:57.732519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:33:07.981491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T04:33:18.247946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T04:33:20.766Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 80 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "5384589d-1adc-4b81-9ca5-012059ac3f24" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.247:46056 10.134.0.247:443 10.133.0.13:40120 - v1-completions-path