2026-11-02T22:37:43.922709Z info FLAG: --concurrency="0" 2026-11-02T22:37:43.922728Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T22:37:43.922733Z info FLAG: --help="false" 2026-11-02T22:37:43.922735Z info FLAG: --log_as_json="false" 2026-11-02T22:37:43.922737Z info FLAG: --log_caller="" 2026-11-02T22:37:43.922739Z info FLAG: --log_output_level="default:info" 2026-11-02T22:37:43.922741Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T22:37:43.922746Z info FLAG: --log_target="[stdout]" 2026-11-02T22:37:43.922748Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T22:37:43.922751Z info FLAG: --outlierLogPath="" 2026-11-02T22:37:43.922753Z info FLAG: --profiling="true" 2026-11-02T22:37:43.922755Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T22:37:43.922757Z info FLAG: --proxyLogLevel="warning" 2026-11-02T22:37:43.922759Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T22:37:43.922762Z info FLAG: --stsPort="0" 2026-11-02T22:37:43.922763Z info FLAG: --templateFile="" 2026-11-02T22:37:43.922765Z info FLAG: --tokenManagerPlugin="" 2026-11-02T22:37:43.922768Z info FLAG: --vklog="0" 2026-11-02T22:37:43.922770Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T22:37:43.922920Z info Proxy role ips=[10.132.0.152] type=router id=maas-default-gateway-openshift-default-fcb75c45f-hpgpb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T22:37:43.922971Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T22:37:43.924108Z info cpu limit detected as 2, setting concurrency 2026-11-02T22:37:43.924394Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T22:37:43.924407Z info JWT policy is third-party-jwt 2026-11-02T22:37:43.924411Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T22:37:43.926169Z info Starting default Istio SDS Server 2026-11-02T22:37:43.926197Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T22:37:43.926224Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T22:37:43.926545Z info Opening status port 15020 2026-11-02T22:37:43.927408Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T22:37:43.928858Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T22:37:43.929740Z info Starting proxy agent 2026-11-02T22:37:43.929783Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T22:37:43.939222Z info sds Starting SDS grpc server 2026-11-02T22:37:43.939262Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T22:37:43.992559Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T22:37:44.043153Z info cache generated new workload certificate resourceName=default latency=115.845061ms ttl=23h59m59.956851295s 2026-11-02T22:37:44.043190Z info cache Root cert has changed, start rotating root cert 2026-11-02T22:37:44.043229Z info cache returned workload trust anchor from cache ttl=23h59m59.956771455s 2026-11-02T22:37:44.151863Z info ads ADS: new connection for node:1 2026-11-02T22:37:44.151943Z info cache returned workload certificate from cache ttl=23h59m59.848058699s 2026-11-02T22:37:44.151999Z info ads ADS: new connection for node:2 2026-11-02T22:37:44.152077Z info cache returned workload trust anchor from cache ttl=23h59m59.847925262s 2026-11-02T22:37:44.238794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:37:52.179412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:37:53.061942Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T22:37:53.427731Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T22:37:54.347527Z info Readiness succeeded in 10.427666444s 2026-11-02T22:37:54.347858Z info Envoy proxy is ready 2026-11-02T22:38:04.897102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:38:14.253365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:38:24.189500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:38:42.833584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:38:45.235318Z info ads ADS: new connection for node:3 2026-11-02T22:38:45.235537Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T22:38:45.235581Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T22:38:48.042743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:39:28.635437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:39:37.898Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 341 94 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "089bf42c-75bf-4cff-ba9f-684033ff2638" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.132.0.154:8000" outbound|54321||e2e-prio-pool-58e3ef14-inference-pool-ip-a6af34d1.llm.svc.cluster.local 10.132.0.152:47330 10.132.0.152:443 10.132.0.20:49614 - v1-model-routing 2026-11-02T22:39:51.910493Z info ads ADS: "" 3 terminated 2026-11-02T22:39:52.383849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:39:57.358522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:40:10.727212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:42:44.296147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:43:08.684509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:43:28.317213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:43:42.274635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:43:59.685065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:43:59.685103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:43:59.685115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:43:59.685120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-02T22:43:59.623Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 61 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "f9dcaa21-5c98-4187-b2cd-ad5bae891cce" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.152:40504 10.132.0.152:443 10.132.0.20:58834 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:44:00.905503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:44:13.216042Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:44:18.353236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:44:23.348Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 70 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "d8d6e9f6-4e35-44d3-aaf2-ab922f2be6a0" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:50574 10.132.0.152:443 10.132.0.20:34004 - v1-completions-path 2026-11-02T22:44:39.206935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:45:26.670610Z info ads ADS: new connection for node:4 2026-11-02T22:45:26.675270Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T22:45:26.675526Z info cache read certificate from file resource=file-root:system 2026-11-02T22:45:30.187542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:45:31.716122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:46:20.219093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:46:20.219150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:46:20.219161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:46:20.219166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:46:20.219331Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T22:46:17.004Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1712 3214 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "330f536d-77e4-4433-a1c3-3abd3e101f61" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.152:47506 10.132.0.152:443 10.132.0.20:38872 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T22:46:24.940237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:24.940266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:24.940276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:46:24.940280Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:24.940442Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T22:46:24.751Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 189 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "19e9f075-bf1a-4cee-91ad-26891a2a50ac" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.152:38884 10.132.0.152:443 10.132.0.20:41392 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T22:46:53.308621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-02T22:46:53.309153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:53.309175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:53.309185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T22:46:53.309189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:46:53.309340Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T22:46:53.176Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 132 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "7953477d-b577-496b-8c9f-9f6fedfe3f07" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.152:38884 10.132.0.152:443 10.132.0.20:45224 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T22:47:17.674854Z info ads ADS: "" 4 terminated 2026-11-02T22:47:17.749372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:47:18.688216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:47:23.734392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:47:29.356664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:47:36.302Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "a851d10c-2ee8-49be-adba-ee2cf25722fd" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:50574 10.132.0.152:443 10.132.0.20:38836 - v1-completions-path 2026-11-02T22:47:52.172267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:47:57.030544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:48:21.394293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:48:34.477185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:48:45.914Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "5e2fb9f3-5102-4adb-8a7c-4ccf25cea858" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:50574 10.132.0.152:443 10.132.0.20:45586 - v1-completions-path 2026-11-02T22:49:05.004349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:49:15.693610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:49:20.548279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:49:34.701Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "f9e2b054-57d3-4d8c-875f-d84e01490512" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:54342 10.132.0.152:443 10.132.0.20:37514 - v1-completions-path 2026-11-02T22:49:35.249159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T22:49:35.193Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "11c256dc-111c-4ce8-b74f-a96525ea8e27" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:54342 10.132.0.152:443 10.132.0.20:37528 - v1-completions-path 2026-11-02T22:49:50.283016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:49:55.049893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:50:08.826022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:50:18.312747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:50:29.125915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:50:30.062Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 71 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "bebc577c-8c7c-4470-8601-34a7d21df9f6" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.133.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:35024 10.132.0.152:443 10.132.0.20:42902 - v1-completions-path 2026-11-02T22:50:35.785422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:50:50.623889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:51:03.491924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:51:09.507538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:51:29.751025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:51:35.335635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:51:46.827024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:52:12.932857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:52:23.614680Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:52:42.444570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:52:47.361387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:55:21.313024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:56:27.749637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:56:27.749675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:56:27.749690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-02T22:56:27.749695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T22:56:27.632Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 117 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "7d016b6a-8400-4200-80c7-ffcb4b0c8b24" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.152:52150 10.132.0.152:443 10.132.0.20:37436 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:56:50.645396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:57:07.609044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:57:12.170023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:57:12.964948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:57:12.965000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:57:12.965025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T22:57:12.965032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T22:57:12.817Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 147 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "f79659f7-5ee6-483a-9077-ea6760546a5f" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.132.0.49:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.152:39090 10.132.0.152:443 10.132.0.20:48708 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T22:57:23.472377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:57:41.322423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:57:47.646765Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:57:50.872Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 73 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "7ba5a6ac-942e-4504-be92-077ed6b928c0" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:54342 10.132.0.152:443 10.132.0.20:44080 - v1-completions-path 2026-11-02T22:58:07.326964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:58:17.884299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:58:23.996104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T22:58:34.778Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "108f16cc-0145-42d2-92de-cd986d33de1e" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:54342 10.132.0.152:443 10.132.0.20:57578 - v1-completions-path 2026-11-02T22:58:51.019509Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:58:57.120116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:59:02.817322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:59:10.063976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:10.064017Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:10.064033Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T22:59:10.064039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T22:59:09.953Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 110 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "9a69a1da-7e14-47b8-a2a9-44544250e1be" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.242:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.152:41952 10.132.0.152:443 10.132.0.20:47520 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T22:59:13.915Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "1df652e9-74a0-406f-8d40-5b5fd7321b63" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.152:50574 10.132.0.152:443 10.132.0.20:44732 - v1-completions-path 2026-11-02T22:59:33.388800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:59:44.250097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:59:50.576299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T22:59:57.724672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:00:08.540527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-11-02T23:00:18.119Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 70 - "34.228.250.194,10.132.0.20" "python-requests/2.34.2" "0d74c1f2-4ace-4f79-813e-bd4a2c39ede8" "maas.apps.1f35823228f5b77bf43a.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.152:443 10.132.0.20:36060 - v1-completions-path 2026-11-02T23:00:32.001360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:00:42.597534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:00:47.172964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:01:05.197609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:01:11.768621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:01:31.790337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:01:53.346658Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:02:15.416090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:02:35.474450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:02:46.371080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:02:57.116293Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:03:07.843740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:03:18.672749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-11-02T23:03:29.253079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7