2026-11-01T06:57:24.999959Z info FLAG: --concurrency="0" 2026-11-01T06:57:24.999985Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:57:24.999989Z info FLAG: --help="false" 2026-11-01T06:57:24.999991Z info FLAG: --log_as_json="false" 2026-11-01T06:57:24.999993Z info FLAG: --log_caller="" 2026-11-01T06:57:24.999995Z info FLAG: --log_output_level="default:info" 2026-11-01T06:57:24.999997Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:57:25.000001Z info FLAG: --log_target="[stdout]" 2026-11-01T06:57:25.000003Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:57:25.000005Z info FLAG: --outlierLogPath="" 2026-11-01T06:57:25.000007Z info FLAG: --profiling="true" 2026-11-01T06:57:25.000008Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:57:25.000010Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:57:25.000013Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:57:25.000015Z info FLAG: --stsPort="0" 2026-11-01T06:57:25.000016Z info FLAG: --templateFile="" 2026-11-01T06:57:25.000018Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:57:25.000021Z info FLAG: --vklog="0" 2026-11-01T06:57:25.000023Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:57:25.000166Z info Proxy role ips=[10.134.0.155] type=router id=maas-default-gateway-openshift-default-855f9574cf-dtgh2.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:57:25.000213Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:57:25.001441Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:57:25.001668Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:57:25.001679Z info JWT policy is third-party-jwt 2026-11-01T06:57:25.001682Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:57:25.003316Z info Starting default Istio SDS Server 2026-11-01T06:57:25.003342Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:57:25.003364Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:57:25.003729Z info Opening status port 15020 2026-11-01T06:57:25.004537Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:57:25.005628Z info sds Starting SDS grpc server 2026-11-01T06:57:25.005710Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:57:25.005951Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:57:25.006944Z info Starting proxy agent 2026-11-01T06:57:25.006985Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:57:25.081862Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:57:25.114816Z info cache generated new workload certificate resourceName=default latency=108.996992ms ttl=23h59m59.885189139s 2026-11-01T06:57:25.114937Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:57:25.114984Z info cache returned workload trust anchor from cache ttl=23h59m59.885017338s 2026-11-01T06:57:25.267024Z info ads ADS: new connection for node:1 2026-11-01T06:57:25.267125Z info cache returned workload certificate from cache ttl=23h59m59.732878522s 2026-11-01T06:57:25.267678Z info ads ADS: new connection for node:2 2026-11-01T06:57:25.267747Z info cache returned workload trust anchor from cache ttl=23h59m59.732254669s 2026-11-01T06:57:25.356586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:57:33.511762Z info Readiness succeeded in 8.514669035s 2026-11-01T06:57:33.512197Z info Envoy proxy is ready 2026-11-01T06:59:53.336734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:12.409572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:19.638798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:40.798490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:00:48.143190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:10.602072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:21.854123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:41.307726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:01:52.466668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:03.471227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:14.239999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:25.034364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:45.750109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:02:56.681880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:07.417642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:03:18.193134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:05:45.468152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:04.672993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:09.389761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:12.650372Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-01T07:06:12.564Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 86 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "aab35a3d-20fa-4feb-b016-503e4f7864e5" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:41594 10.134.0.155:443 10.132.0.10:39528 - v1-catch-all-path 2026-11-01T07:06:18.703131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:22.084311Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T07:06:22.015Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 69 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "7d85a8c8-d9fa-4a44-9d63-f543da1d739a" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:53300 10.134.0.155:443 10.132.0.10:36668 - v1-catch-all-path 2026-11-01T07:06:32.088049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:06:50.294153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:06.930489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:18.799382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:07:21.947886Z info ads ADS: new connection for node:3 2026-11-01T07:07:21.948114Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:21.948147Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T07:07:25.435578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:04.603016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:08:07.667Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 98 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "dbcf15f9-1906-486f-a8ad-766f2e4ee6e9" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.168:8000" outbound|54321||e2e-prio-pool-fade3a71-inference-pool-ip-e6f39fc6.llm.svc.cluster.local 10.134.0.155:39326 10.134.0.155:443 10.132.0.10:56914 - v1-model-routing 2026-11-01T07:08:28.676855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:28.705603Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T07:08:33.319339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:08:44.841173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:09:17.258270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:09:47.619359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:15.170879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:10:46.004369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:01.296021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:17.011792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:11:17.011862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:11:17.011884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:11:17.011891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:11:16.880Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 131 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "fe9ed2aa-5496-4911-802c-3471c74f57f9" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:57202 10.134.0.155:443 10.132.0.10:42846 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:11:18.915120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:30.706480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:11:35.584441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:11:39.906Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 75 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "1c98c9f1-fa54-4023-9745-e8aac56ec294" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:43590 10.134.0.155:443 10.132.0.10:52966 - v1-completions-path 2026-11-01T07:11:55.111199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:12:09.219Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 76 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "bc24da2f-31e8-42b1-b09d-33124259e41e" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:39132 10.134.0.155:443 10.132.0.10:43468 - v1-completions-path 2026-11-01T07:12:49.266776Z info ads ADS: new connection for node:4 2026-11-01T07:12:49.270520Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T07:12:49.270569Z info cache read certificate from file resource=file-root:system 2026-11-01T07:12:53.062424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:12:54.185306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:13:38.976742Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-01T07:13:38.977326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:38.977351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:38.977363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:13:38.977370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:13:38.977525Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T07:13:38.854Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 123 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "2b864735-0b3b-48ad-89ae-19b6fabe02ea" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.155:49190 10.134.0.155:443 10.132.0.10:48526 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:14:02.223716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:14:02.223756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:14:02.223772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T07:14:02.223779Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:14:02.224044Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T07:14:02.110Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 113 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "de6ccea1-3108-4c7c-a35d-8f904e2ec7f8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.155:49190 10.134.0.155:443 10.132.0.10:34280 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T07:14:32.751454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T07:14:32.762514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:14:32.762552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:14:32.762572Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:14:32.762579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T07:14:32.643Z] "DELETE /v1/api-keys/c6c56d76-5b7c-4fe3-9b18-25e2b30a097c HTTP/1.1" 200 - via_upstream - "-" 0 359 118 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "bebf1364-e590-4aac-ab31-3cc853aed6cf" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:60416 10.134.0.155:443 10.132.0.10:38694 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:14:46.108643Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T07:14:46.151193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:48.745215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:14:58.882779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:31.058007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:15:54.330754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:28.776922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:39.518066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:16:54.603020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:17:01.254Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 64 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "0cabbde0-1d58-494e-b92c-a7ec53ea7d8f" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:56498 10.134.0.155:443 10.132.0.10:44842 - v1-completions-path [2026-11-01T07:17:02.652Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "2a9f2393-c5b7-4185-9700-106d7bce0a4a" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:43590 10.134.0.155:443 10.132.0.10:44856 - v1-completions-path [2026-11-01T07:17:03.669Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 53 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "e1964954-1908-4c4b-8761-d542895423e7" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:56498 10.134.0.155:443 10.132.0.10:44874 - v1-completions-path 2026-11-01T07:17:18.054970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:30.222237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:39.419781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:17:52.441737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:01.808965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:10.877169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:20.132851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:36.905001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:18:48.168365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:19.805660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:19:19.805696Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:19:19.805710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:19:19.805717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:19:19.691Z] "DELETE /v1/api-keys/f6091880-eb2c-46b7-b214-b6f0cad63ba4 HTTP/1.1" 404 - via_upstream - "-" 0 29 113 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "a0aa3527-9f2f-41d2-bc26-01adfe566912" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:46592 10.134.0.155:443 10.132.0.10:55728 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:19:28.094229Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:19:56.621230Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:20:07.459048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:04.800278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:21:09.575949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:23:57.741705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:23:57.741757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:23:57.741782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:23:57.741789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:23:57.613Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 127 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "b57e5c1c-ec85-4c3e-b4d1-87e1d16d6517" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:35652 10.134.0.155:443 10.132.0.10:54126 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T07:24:18.015631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T07:24:21.055Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 66 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "ba958fce-3be1-44f4-90e1-b21d0adc7241" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:39132 10.134.0.155:443 10.132.0.10:48998 - v1-completions-path 2026-11-01T07:24:27.338421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:24:57.765906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:02.730514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:05.604355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:25:05.604393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:25:05.604409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T07:25:05.604414Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T07:25:05.478Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 125 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "4d6748fe-625f-445c-9101-ba6b450cda04" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:36150 10.134.0.155:443 10.132.0.10:57436 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:25:07.109Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "ee7203cc-70f3-45b2-b616-06f063158c71" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:43590 10.134.0.155:443 10.132.0.10:57460 - v1-completions-path 2026-11-01T07:25:22.427490Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:33.254992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:25:39.612751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:08.589770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:14.853997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:20.880533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:26:26.439922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:26:26.439956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T07:26:26.439971Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T07:26:26.439975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T07:26:26.328Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 111 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "c1531a05-71fe-41f0-8bcd-daa2c56b9970" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.133.0.177:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.155:54308 10.134.0.155:443 10.132.0.10:43548 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T07:26:29.266Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.10" "python-requests/2.33.0" "604c11da-e52a-4158-bb21-22140cb5bef8" "maas.apps.e3191be92d441d8ee738.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.155:43590 10.134.0.155:443 10.132.0.10:43026 - v1-completions-path 2026-11-01T07:26:49.975842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:10.709872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:17.255204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:23.397082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:32.811920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:27:55.644366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:06.336634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T07:28:36.516524Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2