2026-11-01T06:12:06.209908Z info FLAG: --concurrency="0" 2026-11-01T06:12:06.209941Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:12:06.209957Z info FLAG: --help="false" 2026-11-01T06:12:06.209961Z info FLAG: --log_as_json="false" 2026-11-01T06:12:06.209965Z info FLAG: --log_caller="" 2026-11-01T06:12:06.209968Z info FLAG: --log_output_level="default:info" 2026-11-01T06:12:06.209971Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:12:06.209978Z info FLAG: --log_target="[stdout]" 2026-11-01T06:12:06.209981Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:12:06.209984Z info FLAG: --outlierLogPath="" 2026-11-01T06:12:06.209987Z info FLAG: --profiling="true" 2026-11-01T06:12:06.209990Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:12:06.209992Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:12:06.209996Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:12:06.209999Z info FLAG: --stsPort="0" 2026-11-01T06:12:06.210002Z info FLAG: --templateFile="" 2026-11-01T06:12:06.210005Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:12:06.210009Z info FLAG: --vklog="0" 2026-11-01T06:12:06.210013Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:12:06.210164Z info Proxy role ips=[10.134.0.152] type=router id=maas-default-gateway-openshift-default-58d898bd55-tgfm2.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:12:06.210223Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:12:06.211423Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:12:06.211690Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:12:06.211702Z info JWT policy is third-party-jwt 2026-11-01T06:12:06.211704Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:12:06.212988Z info Starting default Istio SDS Server 2026-11-01T06:12:06.213007Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:12:06.213023Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:12:06.213421Z info Opening status port 15020 2026-11-01T06:12:06.214139Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:12:06.214817Z info sds Starting SDS grpc server 2026-11-01T06:12:06.214852Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:12:06.215353Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:12:06.216245Z info Starting proxy agent 2026-11-01T06:12:06.216289Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:12:06.277284Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:12:06.315221Z info cache generated new workload certificate resourceName=default latency=100.295756ms ttl=23h59m59.684782257s 2026-11-01T06:12:06.315251Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:12:06.315282Z info cache returned workload trust anchor from cache ttl=23h59m59.684718689s 2026-11-01T06:12:06.420747Z info ads ADS: new connection for node:1 2026-11-01T06:12:06.420811Z info cache returned workload certificate from cache ttl=23h59m59.579189831s 2026-11-01T06:12:06.420993Z info ads ADS: new connection for node:2 2026-11-01T06:12:06.421065Z info cache returned workload trust anchor from cache ttl=23h59m59.57893663s 2026-11-01T06:12:06.506580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:15.166142Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:15.990010Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:16.774603Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:17.227565Z info Readiness succeeded in 11.021068642s 2026-11-01T06:12:17.227957Z info Envoy proxy is ready 2026-11-01T06:12:17.969615Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-01T06:12:17.884Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a7804d4f-03fe-4e53-90ea-02f4144854bc" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:48658 10.134.0.152:443 10.132.0.14:57580 - v1-catch-all-path 2026-11-01T06:12:26.141585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:35.293898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:38.186343Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T06:12:38.118Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 68 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "33847e43-01cb-4e90-8108-6725628df878" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:60028 10.134.0.152:443 10.132.0.14:39870 - v1-catch-all-path 2026-11-01T06:12:51.874746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:03.504897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:06.593772Z info ads ADS: new connection for node:3 2026-11-01T06:13:06.593943Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:06.593969Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:10.252701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:49.425221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:13:55.394Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 342 89 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "3dc131f6-a945-4859-8da5-193592f35b32" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.1.64:8000" outbound|54321||e2e-prio-pool-25304531-inference-pool-ip-eb3771a1.llm.svc.cluster.local 10.134.0.152:42582 10.134.0.152:443 10.132.0.14:52184 - v1-model-routing 2026-11-01T06:14:13.335587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:13.371404Z info ads ADS: "" 3 terminated 2026-11-01T06:14:18.125315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:32.825616Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:14:32.825652Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:14:32.825667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:14:32.825672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:14:32.868508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:14:32.697Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 325 127 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "2609fd85-c8cf-4c0c-95df-5a15509cf44b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:41454 10.134.0.152:443 10.132.0.14:53608 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:14:44.723952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:11.451700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:36.591696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:51.792416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:00.284614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:15.689777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:20.503794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:16:23.991Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 71 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "cec9b71b-524a-45b3-91ce-b8a14edd73b0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:53174 - v1-completions-path 2026-11-01T06:16:38.693670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:27.624683Z info ads ADS: new connection for node:4 2026-11-01T06:17:27.632094Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:17:27.632146Z info cache read certificate from file resource=file-root:system 2026-11-01T06:17:31.246720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:32.613875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:35.653996Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"121","StreamId":"12216491493743060727"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-01T06:17:35.588Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 66 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "54fdaf8c-7c0a-4f98-9c1b-22f7cec59a18" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.152:443 10.132.0.14:55210 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T06:17:37.915488Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"124","StreamId":"2607907545969858912"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-01T06:17:37.853Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c1227cfd-b9b4-47f4-b8bb-cdca56dd75b0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.0.152:443 10.132.0.14:49964 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-01T06:17:49.340769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-01T06:17:49.455478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:17:49.455515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:17:49.455527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:17:49.455531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:17:49.455691Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:17:49.282Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 173 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "57819dd1-e7e6-434c-b0ef-aaf3e15b2c57" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45428 10.134.0.152:443 10.132.0.14:58174 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:17:51.652102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T06:17:51.760926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:17:51.760955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:17:51.760965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:17:51.760969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:17:51.761122Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T06:17:51.646Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 115 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ecd96040-650a-4c89-b76f-fb601379b3b6" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45432 10.134.0.152:443 10.132.0.14:58184 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:03.365806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:03.365843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:03.365854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:03.365858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:18:03.366004Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:18:03.255Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 110 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "57fa5149-e44e-4d2f-97a4-52930f39305c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45428 10.134.0.152:443 10.132.0.14:35868 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:08.015403Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:08.015436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:08.015476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:18:08.015482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:18:08.015646Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T06:18:07.906Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 109 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "6696dea8-f826-4812-bc59-0a0e427fe9e7" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45428 10.134.0.152:443 10.132.0.14:45286 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:10.330006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:10.330042Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:10.330055Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:10.330061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:18:10.330224Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T06:18:10.217Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 113 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "13b053c1-7320-4114-b78c-2346e638fc1d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45432 10.134.0.152:443 10.132.0.14:45298 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:18:31.244158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:31.244193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:31.244204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:18:31.244209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:18:31.244384Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T06:18:31.127Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 116 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d13063e9-5b14-403e-aee7-141330ac6964" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.152:45432 10.134.0.152:443 10.132.0.14:40774 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T06:19:23.791970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:23.818801Z info ads ADS: "" 4 terminated 2026-11-01T06:19:26.338496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:36.612137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:54.874051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:11.778102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:42.512441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:53.039061Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:59.445367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:21:12.410Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "849442f0-22fa-4359-a7c3-367d924480a8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:57350 - v1-completions-path 2026-11-01T06:21:28.102257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:32.665532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:35.877800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:21:35.877838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:21:35.877854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:21:35.877859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T06:21:35.752Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 125 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "f4f28df7-35d7-45e7-96b5-f13f691f9cae" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:47288 10.134.0.152:443 10.132.0.14:58012 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:21:45.949708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:55.910307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:19.616766Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:30.210088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:48.202315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:54.314073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:12.519756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:23:14.801Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "02537dc4-bc3a-4c0f-909c-8250422c47e5" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.152:443 10.132.0.14:51772 - v1-completions-path 2026-11-01T06:23:17.939355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:19.937207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:23:19.937244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:23:19.937256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:23:19.937261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:23:20.242254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:23:20.242290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:23:20.242306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:23:20.242311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T06:23:19.828Z] "DELETE /v1/api-keys/a6ad897c-cc62-4645-9db0-205769cf5902 HTTP/1.1" 404 - via_upstream - "-" 0 29 108 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "33367253-3014-44d7-95b4-6537a521b7c0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:48352 10.134.0.152:443 10.132.0.14:47454 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:23:20.132Z] "DELETE /v1/api-keys/316b7021-9e1e-464c-9009-8755c85ed3d4 HTTP/1.1" 200 - via_upstream - "-" 0 375 109 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d87936ef-ecb2-4245-b942-9a266eb3561d" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:48364 10.134.0.152:443 10.132.0.14:47456 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:23:21.613Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 34 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "5eb4a868-fbaa-4392-a753-88ddd57112e2" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.152:443 10.132.0.14:47470 - v1-completions-path 2026-11-01T06:23:29.242066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:23:41.933Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 66 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "2577dae8-dd73-4808-b16e-7220bb6dc00a" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:53418 10.134.0.152:443 10.132.0.14:45044 - v1-completions-path [2026-11-01T06:23:42.194Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "63c923bd-aa0e-4316-b716-a9dd1d2f3a2b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:45052 - v1-completions-path 2026-11-01T06:23:56.014758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:06.667854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:54.911788Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:02.519041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:27:12.308Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 48 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "545df370-5c15-40fd-bff7-2d645b77ce0f" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.152:443 10.132.0.14:44676 - v1-completions-path 2026-11-01T06:27:16.564659Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:45.037563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:04.542470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:09.515767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:21.374872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:38.153516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:43.066825Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:46.001552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:29:46.001587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:29:46.001602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T06:29:46.001606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T06:29:45.883Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 118 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c28874d8-d5bb-4003-ae6e-c70fca4b0f37" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.132:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:40224 10.134.0.152:443 10.132.0.14:39276 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:29:46.210Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 71 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "fa4336bc-d42e-4055-b086-4421c31c99bb" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:39292 - v1-completions-path [2026-11-01T06:29:47.103Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "39fec8ef-6130-4dc3-b2b0-44a7fb8bc4c3" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:53418 10.134.0.152:443 10.132.0.14:39296 - v1-completions-path 2026-11-01T06:30:02.759990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:13.384566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:19.928256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:48.852860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:55.299237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:01.226807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:31:10.652Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "80083f01-79a9-441e-85b7-dc13afb342b2" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:53418 10.134.0.152:443 10.132.0.14:60406 - v1-completions-path [2026-11-01T06:31:12.719Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "c0d27302-92b0-4084-b5b1-df7388f15747" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:53418 10.134.0.152:443 10.132.0.14:60416 - v1-completions-path [2026-11-01T06:31:16.660Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "d310374b-e4f8-4a8b-a537-a658f27c6a53" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:60434 - v1-completions-path [2026-11-01T06:31:19.167Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "6c59897d-012e-4e93-84ff-fb9f2c0a7945" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.152:443 10.132.0.14:56394 - v1-completions-path 2026-11-01T06:31:33.411599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:44.124638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:50.734810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:56.549987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:08.567580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:32:15.994Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "82591606-2333-42ea-b356-2d48776861e6" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:34824 - v1-completions-path [2026-11-01T06:32:17.847Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "499d1474-dbf8-4b72-8bb2-32329689da29" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:38072 10.134.0.152:443 10.132.0.14:49348 - v1-completions-path 2026-11-01T06:32:32.225634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:42.898421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:47.625551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:05.808071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:11.930216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:35.607538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:57.666000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:17.573747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:28.446171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:39.360120Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:50.306206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:01.007725Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:11.820370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:22.563500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:32.831544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:35:32.831577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:35:32.831592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T06:35:32.831598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T06:35:33.171233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:35:32.712Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 118 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "ab33e8f7-dc4e-4c27-b736-77d9b45d375b" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.134.0.159:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.152:39496 10.134.0.152:443 10.132.0.14:49242 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:35:43.626Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 93 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "fd0bb7e8-8b43-4578-b6f3-12a1297956f0" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.152:54834 10.134.0.152:443 10.132.0.14:44104 - v1-completions-path