2026-11-03T03:16:48.128983Z info FLAG: --concurrency="0" 2026-11-03T03:16:48.129001Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T03:16:48.129006Z info FLAG: --help="false" 2026-11-03T03:16:48.129009Z info FLAG: --log_as_json="false" 2026-11-03T03:16:48.129012Z info FLAG: --log_caller="" 2026-11-03T03:16:48.129015Z info FLAG: --log_output_level="default:info" 2026-11-03T03:16:48.129018Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T03:16:48.129023Z info FLAG: --log_target="[stdout]" 2026-11-03T03:16:48.129027Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T03:16:48.129031Z info FLAG: --outlierLogPath="" 2026-11-03T03:16:48.129034Z info FLAG: --profiling="true" 2026-11-03T03:16:48.129037Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T03:16:48.129040Z info FLAG: --proxyLogLevel="warning" 2026-11-03T03:16:48.129043Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T03:16:48.129046Z info FLAG: --stsPort="0" 2026-11-03T03:16:48.129048Z info FLAG: --templateFile="" 2026-11-03T03:16:48.129051Z info FLAG: --tokenManagerPlugin="" 2026-11-03T03:16:48.129055Z info FLAG: --vklog="0" 2026-11-03T03:16:48.129058Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T03:16:48.129242Z info Proxy role ips=[10.134.1.36] type=router id=maas-default-gateway-openshift-default-5bc884dd87-p8fqq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T03:16:48.129293Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T03:16:48.131087Z info cpu limit detected as 2, setting concurrency 2026-11-03T03:16:48.131470Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T03:16:48.131546Z info JWT policy is third-party-jwt 2026-11-03T03:16:48.131574Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T03:16:48.133581Z info Starting default Istio SDS Server 2026-11-03T03:16:48.133657Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T03:16:48.133685Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T03:16:48.134300Z info Opening status port 15020 2026-11-03T03:16:48.135527Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T03:16:48.137491Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T03:16:48.138767Z info Starting proxy agent 2026-11-03T03:16:48.138848Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T03:16:48.152806Z info sds Starting SDS grpc server 2026-11-03T03:16:48.152835Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T03:16:48.203097Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T03:16:48.231730Z info cache generated new workload certificate resourceName=default latency=96.325561ms ttl=23h59m59.768273495s 2026-11-03T03:16:48.231764Z info cache Root cert has changed, start rotating root cert 2026-11-03T03:16:48.231793Z info cache returned workload trust anchor from cache ttl=23h59m59.768207705s 2026-11-03T03:16:48.351171Z info ads ADS: new connection for node:1 2026-11-03T03:16:48.351235Z info cache returned workload certificate from cache ttl=23h59m59.648766935s 2026-11-03T03:16:48.352030Z info ads ADS: new connection for node:2 2026-11-03T03:16:48.352097Z info cache returned workload trust anchor from cache ttl=23h59m59.647903627s 2026-11-03T03:16:48.440245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:16:56.254504Z info Readiness succeeded in 8.128035905s 2026-11-03T03:16:56.254861Z info Envoy proxy is ready 2026-11-03T03:17:26.458620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:17:29.690Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 319 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "e3f2aa3e-908c-4f5d-8ab2-b054300566b2" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:51360 10.134.1.36:443 10.132.0.20:55170 - v1-chat-completions-path [2026-11-03T03:17:30.691Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 314 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3c533000-4e3e-406e-8d95-a0ff91cdd731" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:51368 10.134.1.36:443 10.132.0.20:55182 - v1-chat-completions-path 2026-11-03T03:17:45.269995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:48.295598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:17:57.555513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:01.812791Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T03:18:01.740Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "63921cc6-6762-9b5c-b665-5aa45a83acdb" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:39760 10.134.1.36:443 10.132.0.20:38832 - v1-catch-all-path 2026-11-03T03:18:10.368615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:20.055823Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:36.638219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:48.394281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:18:53.012233Z info ads ADS: new connection for node:3 2026-11-03T03:18:53.012391Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:53.012421Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T03:18:57.370631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:19:40.015107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:19:47.312Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 331 89 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3a7eb485-ee7e-49d8-a6f0-32047e7644d8" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.134.1.41:8000" outbound|54321||e2e-prio-pool-e934465c-inference-pool-ip-6641cb70.llm.svc.cluster.local 10.134.1.36:60162 10.134.1.36:443 10.132.0.20:33950 - v1-model-routing 2026-11-03T03:20:05.213064Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T03:20:05.270423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:20:11.362932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:20:27.074494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:23:23.086560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:23:47.499013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:13.557283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:28.875863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:37.076633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:49.979810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:24:54.558961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:25:12.641661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:26:01.082612Z info ads ADS: new connection for node:4 2026-11-03T03:26:01.087756Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T03:26:01.087804Z info cache read certificate from file resource=file-root:system 2026-11-03T03:26:05.069389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:26:06.059854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:27:15.986908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:15.986938Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:15.986947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T03:27:15.986951Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:15.987134Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T03:27:15.792Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 194 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "6aea4bb8-cad4-4dfc-8326-0f8dadd9ccef" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.36:59002 10.134.1.36:443 10.132.0.20:60302 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:27:32.458573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:32.458601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:32.458611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T03:27:32.458615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T03:27:32.458774Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T03:27:32.336Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 122 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a8e42145-dae0-425a-b06d-2633ab329b9e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.36:59002 10.134.1.36:443 10.132.0.20:52386 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T03:28:00.307203Z info ads ADS: "" 4 terminated 2026-11-03T03:28:00.354769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:02.794203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:13.104209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:31.618609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:36.010455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:28:40.492284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T03:28:41.089350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T03:28:40.486Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4c20c958-36a6-453b-aeb5-e02a5580c83b" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:58342 - v1-completions-path [2026-11-03T03:28:41.028Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ffd7d9a6-d9ee-4609-9d25-547db969c501" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37504 10.134.1.36:443 10.132.0.20:58362 - v1-completions-path 2026-11-03T03:28:55.747570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:29:12.671460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:29:22.442Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "af362262-e950-4c9c-a366-109822f68b38" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:33050 - v1-completions-path [2026-11-03T03:29:22.959Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "351b0dcc-d1f9-4da2-b4f5-18951e42628e" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:33056 - v1-completions-path [2026-11-03T03:29:23.218Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 113 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c25e2c16-3b6c-40de-a5cc-1182c3152a64" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37504 10.134.1.36:443 10.132.0.20:33066 - v1-completions-path 2026-11-03T03:29:43.623682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:29:54.287677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:00.380632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:30:15.520Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "073baf49-cdf6-4305-bb95-0bffb4decea5" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:56704 - v1-completions-path [2026-11-03T03:30:16.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3c87cccc-7b69-4501-b60b-2dd135114a0a" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:56706 - v1-completions-path 2026-11-03T03:30:30.327940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:34.952898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:47.597080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:30:56.223404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:05.173084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:14.026074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:22.910497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:31:41.067100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:32:12.439304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:32:32.722229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:32:43.401467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:35:35.776269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:07.382090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:37:10.012Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 295 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "cae8e10e-788e-46a5-b985-05f6db93c205" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:56916 10.134.1.36:443 10.132.0.20:35768 - v1-completions-path 2026-11-03T03:37:24.530064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:29.341630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:30.099935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:37:30.099990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:37:30.100015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:37:30.100023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T03:37:29.959Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 141 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1d5f3703-5bb1-4c29-8c7c-713ca12a3e23" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.36:41628 10.134.1.36:443 10.132.0.20:43380 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:37:32.694243Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:37:32.694270Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:37:32.694273Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T03:37:32.694277Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T03:37:32.659Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f77c9e48-777c-4da6-8e81-84e06d1d47ac" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.36:443 10.132.0.20:43396 - v1-completions-path 2026-11-03T03:37:41.920391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:37:59.474511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:05.919515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:38:09.592Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a52d3fe4-f3e6-4710-a9f1-9650e4ab0dc4" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37504 10.134.1.36:443 10.132.0.20:48124 - v1-completions-path 2026-11-03T03:38:25.873762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:36.612011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:38:42.737438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:10.086254Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:16.274155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:39:21.931766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:39:36.690Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "25303375-e646-46a9-a15c-86133583e0cd" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37504 10.134.1.36:443 10.132.0.20:32776 - v1-completions-path [2026-11-03T03:39:38.465Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "184144e7-4add-43e2-8ee2-dc03b3fd4078" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37500 10.134.1.36:443 10.132.0.20:32792 - v1-completions-path 2026-11-03T03:39:39.512924Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:39:39.512962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:39:39.512977Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T03:39:39.512983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T03:39:39.400Z] "DELETE /v1/api-keys/6244918c-7176-48cd-b5c0-721810bd7d79 HTTP/1.1" 200 - via_upstream - "-" 0 365 112 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7668577a-a742-4bda-8754-be9c9cf29b7c" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.132.0.151:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.36:45954 10.134.1.36:443 10.132.0.20:34690 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T03:39:52.956500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:03.814449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:10.165857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:15.994936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:26.266559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:40:32.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d348077a-ed74-4ac4-88f1-56d9048ae763" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:37504 10.134.1.36:443 10.132.0.20:51052 - v1-completions-path 2026-11-03T03:40:48.808479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:40:59.637393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:04.384337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:20.310509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:26.246131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:41:50.120015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:12.181839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:32.462393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:42:45.140259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:05.012088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:15.686513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:26.554051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:37.353166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T03:43:47.898775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T03:43:53.717Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 195 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7c535974-ddaf-48da-89ea-d0c8090b7f48" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "10.133.0.43:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.36:51208 10.134.1.36:443 10.132.0.20:43378 - v1-completions-path [2026-11-03T03:43:57.260Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "6c4c026d-1a0e-4f52-899d-60afc3bb91fb" "maas.apps.abf4b066b9836acb0417.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.36:443 10.132.0.20:43398 - v1-completions-path