2026-10-30T04:12:13.000489Z info FLAG: --concurrency="0" 2026-10-30T04:12:13.000509Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T04:12:13.000515Z info FLAG: --help="false" 2026-10-30T04:12:13.000518Z info FLAG: --log_as_json="false" 2026-10-30T04:12:13.000521Z info FLAG: --log_caller="" 2026-10-30T04:12:13.000524Z info FLAG: --log_output_level="default:info" 2026-10-30T04:12:13.000528Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T04:12:13.000534Z info FLAG: --log_target="[stdout]" 2026-10-30T04:12:13.000537Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T04:12:13.000540Z info FLAG: --outlierLogPath="" 2026-10-30T04:12:13.000544Z info FLAG: --profiling="true" 2026-10-30T04:12:13.000547Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T04:12:13.000550Z info FLAG: --proxyLogLevel="warning" 2026-10-30T04:12:13.000553Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T04:12:13.000556Z info FLAG: --stsPort="0" 2026-10-30T04:12:13.000559Z info FLAG: --templateFile="" 2026-10-30T04:12:13.000563Z info FLAG: --tokenManagerPlugin="" 2026-10-30T04:12:13.000567Z info FLAG: --vklog="0" 2026-10-30T04:12:13.000571Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T04:12:13.000744Z info Proxy role ips=[10.134.0.248] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-sq5vm.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T04:12:13.001039Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T04:12:13.002685Z info cpu limit detected as 2, setting concurrency 2026-10-30T04:12:13.003511Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T04:12:13.005713Z info JWT policy is third-party-jwt 2026-10-30T04:12:13.005730Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T04:12:13.007516Z info Opening status port 15020 2026-10-30T04:12:13.007542Z info Starting default Istio SDS Server 2026-10-30T04:12:13.007740Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T04:12:13.007821Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T04:12:13.008532Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T04:12:13.009097Z info sds Starting SDS grpc server 2026-10-30T04:12:13.009120Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T04:12:13.009738Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T04:12:13.010630Z info Starting proxy agent 2026-10-30T04:12:13.010690Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T04:12:13.100437Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T04:12:13.112263Z info cache generated new workload certificate resourceName=default latency=103.051595ms ttl=23h59m59.887738805s 2026-10-30T04:12:13.112295Z info cache Root cert has changed, start rotating root cert 2026-10-30T04:12:13.112331Z info cache returned workload trust anchor from cache ttl=23h59m59.887669635s 2026-10-30T04:12:13.252780Z info ads ADS: new connection for node:1 2026-10-30T04:12:13.252783Z info ads ADS: new connection for node:2 2026-10-30T04:12:13.252838Z info cache returned workload certificate from cache ttl=23h59m59.74716356s 2026-10-30T04:12:13.252988Z info cache returned workload trust anchor from cache ttl=23h59m59.747014931s 2026-10-30T04:12:13.353598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:12:21.772190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:12:22.606686Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T04:12:23.607982Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T04:12:24.398986Z info Readiness succeeded in 11.401386752s 2026-10-30T04:12:24.399305Z info Envoy proxy is ready 2026-10-30T04:12:52.844135Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T04:12:54.924128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:12:58.419Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 84 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "aed0824e-59fe-4b13-a373-ba6650514790" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:36392 10.134.0.248:443 10.133.0.13:34230 - v1-chat-completions-path 2026-10-30T04:13:10.698942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:13:13.229101Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:13:16.260710Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T04:13:16.183Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 77 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "56f8d4f9-e441-4e04-aec7-73588e4862bd" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.51:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:36328 10.134.0.248:443 10.133.0.13:60278 - v1-catch-all-model-routing 2026-10-30T04:13:19.742404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:13:27.253176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:13:36.503390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:13:51.212297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:14:02.178497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:14:04.047030Z info ads ADS: new connection for node:3 2026-10-30T04:14:04.055046Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:14:04.055149Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T04:14:06.060631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:14:46.823891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:14:51.917Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 346 89 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "77d50a4f-b385-4789-a32a-bea366bd4231" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.1.90:8000" outbound|54321||e2e-prio-pool-f2b786ee-inference-pool-ip-19c7a697.llm.svc.cluster.local 10.134.0.248:51070 10.134.0.248:443 10.133.0.13:50484 - v1-model-routing 2026-10-30T04:15:05.712338Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T04:15:05.762255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:15:08.406437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T04:15:08.321Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 85 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "d16545e0-03b9-4e3d-898e-e60869ce6331" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:60076 10.134.0.248:443 10.133.0.13:50878 - v1-completions-path 2026-10-30T04:15:09.322294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:15:17.437596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:16:45.009819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:01.365362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:17.506793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:29.361849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:33.377281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:44.406933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:17:47.974707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:18:03.022193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:18:50.191921Z info ads ADS: new connection for node:4 2026-10-30T04:18:50.199365Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T04:18:50.199408Z info cache read certificate from file resource=file-root:system 2026-10-30T04:18:51.265320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:18:52.924783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:18:55.786023Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"130","StreamId":"7795412907141990780"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-30T04:18:55.701Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 85 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "24805777-da1d-4f8b-85b1-82052ac63b38" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.248:443 10.133.0.13:55656 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T04:19:27.649964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:27.649994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:27.650005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:19:27.650009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:19:27.650155Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:19:27.541Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 108 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "c66d5b48-4d0f-4cc3-a4a8-cd76f6c14480" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.248:46100 10.134.0.248:443 10.133.0.13:33914 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:19:36.134212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:36.134255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:36.134270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:19:36.134276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:36.134467Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:19:36.022Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 111 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "5048b55f-d99d-479b-a49f-36c822f993b1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.248:35562 10.134.0.248:443 10.133.0.13:58290 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:19:48.872983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:48.873014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:48.873023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:19:48.873027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:19:48.873188Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:19:48.774Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 98 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "9d0e0a92-5993-4ac5-84e0-facdc834acf8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.248:35562 10.134.0.248:443 10.133.0.13:51420 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:20:12.311498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:12.311531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:12.311541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:20:12.311545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:20:12.311693Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T04:20:12.215Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 96 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "094d95aa-80dc-4f32-bc23-ea4b5653435d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.248:35562 10.134.0.248:443 10.133.0.13:50046 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:20:14.432534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:20:14.432570Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:20:14.432581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:20:14.432585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:20:14.432741Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T04:20:14.333Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1724 99 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "5d4e35d0-1b0d-42ea-b7ec-ad53c774d8c5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.248:46100 10.134.0.248:443 10.133.0.13:50066 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T04:20:40.561901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:20:40.685079Z info ads ADS: "" 4 terminated 2026-10-30T04:20:42.077892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:20:48.778953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:20:51.465995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:20:51.466032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:20:51.466048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:20:51.466052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:20:51.380Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 85 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "2cda46e2-332a-4d10-a364-d39708845ff7" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:55762 10.134.0.248:443 10.133.0.13:60906 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:21:04.511873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:21:09.327600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:21:12.129Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 70 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "872720e4-3262-47d8-8c96-228ebb5e5789" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:41352 10.134.0.248:443 10.133.0.13:33242 - v1-completions-path 2026-10-30T04:21:26.200464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:21:40.457319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:21:46.781466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T04:21:46.727Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "893bc296-cb7a-4545-b0ac-ae0a7fb5f4e9" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:55052 10.134.0.248:443 10.133.0.13:56150 - v1-completions-path 2026-10-30T04:22:03.914272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:22:14.138432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:22:18.925258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:22:22.687Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "b88485a4-7018-47a1-aa7e-5b0f5f72689c" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:41352 10.134.0.248:443 10.133.0.13:44966 - v1-completions-path [2026-10-30T04:22:22.956Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 61 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "73308037-4155-463f-b575-b3334ec0cdb4" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:55052 10.134.0.248:443 10.133.0.13:44972 - v1-completions-path [2026-10-30T04:22:23.575Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "05fcdabd-0d22-4c20-8ec4-93089bea41c6" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:55052 10.134.0.248:443 10.133.0.13:44986 - v1-completions-path 2026-10-30T04:22:36.055572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:22:38.416206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:22:39.168898Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:22:39.168950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:22:39.168976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:22:39.168984Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:22:39.055Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 113 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "eea01293-7be7-4cab-a0e1-913523bf9bb9" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:47878 10.134.0.248:443 10.133.0.13:46848 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:22:39.193Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 290 1946 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "5595f069-b402-468b-afd0-279521b6ccc9" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.32:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:43448 10.134.0.248:443 10.133.0.13:46854 - v1-completions-path 2026-10-30T04:22:45.749526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:22:57.547610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:02.895932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:11.040316Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:16.384075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:34.686423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:37.748439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:53.295313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:23:56.211965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:24:04.278682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:24:09.832454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:24:09.832502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:24:09.832520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:24:09.832525Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:24:09.929146Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:24:09.929180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:24:09.929196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:24:09.929200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:24:09.759Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 73 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "23001e26-59c4-4d52-a908-d48c6545cced" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:45314 10.134.0.248:443 10.133.0.13:56632 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T04:24:09.861Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 67 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "4d1a206e-0f79-41a3-9380-fd5823551814" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:45314 10.134.0.248:443 10.133.0.13:56648 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:24:22.223535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:24:32.617828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:24:49.985624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:24:53.465179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:26:24.627365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:26:28.021108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:27:53.218922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:27:56.650406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:27:56.650441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:27:56.650454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T04:27:56.650459Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T04:27:56.577Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 72 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "5c7e37db-7c8f-4dc9-8f94-4a8046baf4c7" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:43816 10.134.0.248:443 10.133.0.13:57022 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:28:08.544779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:28:10.954708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:28:13.823963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:28:13.824000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:28:13.824015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:28:13.824020Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T04:28:13.746Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 77 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "eae45127-5582-4cd4-9c44-6d183486be80" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:57984 10.134.0.248:443 10.133.0.13:40014 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:28:18.137511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:28:38.351870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:28:41.410252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:28:57.014864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:29:07.339920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:29:12.491445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:29:18.190Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "3432b447-0469-4699-8b90-026daaa4d02d" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:41352 10.134.0.248:443 10.133.0.13:53870 - v1-completions-path 2026-10-30T04:29:19.333113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:29:19.333148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T04:29:19.333163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T04:29:19.333168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T04:29:19.261Z] "DELETE /v1/api-keys/371d8605-1eac-44f2-a594-76c9502eac33 HTTP/1.1" 200 - via_upstream - "-" 0 365 72 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "9ce0ca92-158e-4e5a-9587-e414b264b4d5" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.134.1.4:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:49388 10.134.0.248:443 10.133.0.13:53872 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:29:31.236086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:29:35.884597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:29:38.764869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:29:45.565Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "9764021f-b23d-419b-8df8-ce33c2178b6c" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:41352 10.134.0.248:443 10.133.0.13:45250 - v1-completions-path [2026-10-30T04:29:45.930Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "8a7a3d67-5e4a-495b-9fb3-262b1f4bbe92" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:41352 10.134.0.248:443 10.133.0.13:45262 - v1-completions-path [2026-10-30T04:29:46.112Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "76c1c05f-9235-4143-ba3f-bc0f0cc936db" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.248:443 10.133.0.13:45274 - v1-completions-path 2026-10-30T04:29:49.850904Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:29:49.850946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:29:49.850963Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T04:29:49.850968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T04:29:49.776Z] "DELETE /v1/api-keys/9e3504be-2ceb-4033-a4de-e2c6300bf0f7 HTTP/1.1" 200 - via_upstream - "-" 0 363 74 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "6757efc5-53bc-40b6-b083-80a5c3668a7a" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.1.124:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.248:47614 10.134.0.248:443 10.133.0.13:45280 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T04:30:01.857025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:12.206080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:14.754771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:17.655716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:22.864992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:30:27.541Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "e16515af-5cdf-44d9-9c53-226254d195cb" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "10.133.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.248:55052 10.134.0.248:443 10.133.0.13:53468 - v1-completions-path [2026-10-30T04:30:29.046Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 81 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "10479149-35a6-4a51-b113-7975a056e83a" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.248:443 10.133.0.13:53484 - v1-completions-path 2026-10-30T04:30:41.135082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:51.471520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:30:53.949315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:31:03.701836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:31:08.562590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:31:25.366816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:31:45.261739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:31:55.567925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:05.905930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:16.318425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:26.588117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:36.934717Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:47.304432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:32:57.729168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:33:08.014204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T04:33:18.250577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T04:33:25.277Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 41 - "34.228.250.194,10.133.0.13" "python-requests/2.34.2" "e0fa28fa-b6f1-4b66-b3cc-39fe87b34804" "maas.apps.1ef8b236caec72cd892e.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.248:443 10.133.0.13:51280 - v1-completions-path