2026-10-30T02:49:21.893194Z info FLAG: --concurrency="0" 2026-10-30T02:49:21.893224Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T02:49:21.893229Z info FLAG: --help="false" 2026-10-30T02:49:21.893231Z info FLAG: --log_as_json="false" 2026-10-30T02:49:21.893233Z info FLAG: --log_caller="" 2026-10-30T02:49:21.893235Z info FLAG: --log_output_level="default:info" 2026-10-30T02:49:21.893237Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T02:49:21.893243Z info FLAG: --log_target="[stdout]" 2026-10-30T02:49:21.893245Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T02:49:21.893247Z info FLAG: --outlierLogPath="" 2026-10-30T02:49:21.893249Z info FLAG: --profiling="true" 2026-10-30T02:49:21.893253Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T02:49:21.893255Z info FLAG: --proxyLogLevel="warning" 2026-10-30T02:49:21.893257Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T02:49:21.893259Z info FLAG: --stsPort="0" 2026-10-30T02:49:21.893261Z info FLAG: --templateFile="" 2026-10-30T02:49:21.893263Z info FLAG: --tokenManagerPlugin="" 2026-10-30T02:49:21.893266Z info FLAG: --vklog="0" 2026-10-30T02:49:21.893269Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T02:49:21.893427Z info Proxy role ips=[10.132.1.10] type=router id=maas-default-gateway-openshift-default-75d7c785f-4spcb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T02:49:21.893471Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T02:49:21.894669Z info cpu limit detected as 2, setting concurrency 2026-10-30T02:49:21.894887Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T02:49:21.894906Z info JWT policy is third-party-jwt 2026-10-30T02:49:21.894909Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T02:49:21.896653Z info Starting default Istio SDS Server 2026-10-30T02:49:21.897222Z info Opening status port 15020 2026-10-30T02:49:21.897267Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T02:49:21.897292Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T02:49:21.897881Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T02:49:21.898715Z info sds Starting SDS grpc server 2026-10-30T02:49:21.898733Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T02:49:21.899126Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T02:49:21.900029Z info Starting proxy agent 2026-10-30T02:49:21.900060Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T02:49:21.967657Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T02:49:22.085702Z info ads ADS: new connection for node:1 2026-10-30T02:49:22.086225Z info ads ADS: new connection for node:2 2026-10-30T02:49:22.132649Z info cache generated new workload certificate resourceName=default latency=233.790447ms ttl=23h59m59.867355109s 2026-10-30T02:49:22.132685Z info cache Root cert has changed, start rotating root cert 2026-10-30T02:49:22.132718Z info cache returned workload certificate from cache ttl=23h59m59.867287129s 2026-10-30T02:49:22.132736Z info cache returned workload trust anchor from cache ttl=23h59m59.867264347s 2026-10-30T02:49:22.132819Z info cache returned workload trust anchor from cache ttl=23h59m59.867181216s 2026-10-30T02:49:22.133147Z info cache returned workload trust anchor from cache ttl=23h59m59.866853672s 2026-10-30T02:49:22.215188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:49:30.491416Z info Readiness succeeded in 8.600791649s 2026-10-30T02:49:30.491746Z info Envoy proxy is ready 2026-10-30T02:49:38.823467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:49:54.478576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:49:57.607369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:03.762382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:07.023830Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T02:50:06.937Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 86 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "e90ad989-987d-4e59-b42f-3d1e18de55b3" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:51366 10.132.1.10:443 10.132.0.13:42178 - v1-catch-all-path 2026-10-30T02:50:10.938439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:20.538253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:23.612687Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T02:50:23.546Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 66 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "43c7cb52-f393-41c3-ad37-f78c46ad07c0" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.132.0.43:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:51366 10.132.1.10:443 10.132.0.13:52404 - v1-catch-all-path 2026-10-30T02:50:35.622727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:46.608427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:50:50.231032Z info ads ADS: new connection for node:3 2026-10-30T02:50:50.231207Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T02:50:50.231238Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T02:50:52.705224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:51:30.802327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T02:51:35.255Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 90 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "97644424-0c28-462b-a3e6-e6509b3fe6e1" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.132.1.15:8000" outbound|54321||e2e-prio-pool-8b3c5a4d-inference-pool-ip-ce3209d7.llm.svc.cluster.local 10.132.1.10:36054 10.132.1.10:443 10.132.0.13:55928 - v1-model-routing 2026-10-30T02:51:49.828655Z info ads ADS: "" 3 terminated 2026-10-30T02:51:49.886772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:51:53.220893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:52:01.172158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:53:30.033842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:53:47.025956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:07.970012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:19.965294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:26.754474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:38.759417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:42.278064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:54:57.605755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:55:42.103168Z info ads ADS: new connection for node:4 2026-10-30T02:55:42.108080Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T02:55:42.108163Z info cache read certificate from file resource=file-root:system 2026-10-30T02:55:43.158406Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:55:44.743473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:56:00.034120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T02:56:00.088307Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:00.088343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:00.088356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T02:56:00.088360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:00.088584Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T02:55:59.974Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 113 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "13018fde-e507-44bc-908a-2b1870b7ce23" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.10:55882 10.132.1.10:443 10.132.0.13:55610 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T02:56:27.745276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:27.745314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:27.745327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T02:56:27.745331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T02:56:27.745514Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T02:56:27.645Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 99 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "af2a5938-9394-42bb-aad2-c2267eb04841" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.10:55882 10.132.1.10:443 10.132.0.13:44538 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T02:57:34.394816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:57:34.498242Z info ads ADS: "" 4 terminated 2026-10-30T02:57:35.914461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:57:42.817432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:57:58.649183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:58:03.187743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:58:18.511079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:58:34.126616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:58:57.502510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:07.922204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:12.543906Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T02:59:16.785Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 82 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "8c36f965-d86b-4633-b05c-7fed49b6965d" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:58048 - v1-completions-path [2026-10-30T02:59:17.177Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "673ee004-dc1e-49c6-9daf-7400f32f3c18" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:58060 - v1-completions-path 2026-10-30T02:59:29.525353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:31.878001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:38.927107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:51.221754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T02:59:56.476144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:04.770753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:10.042819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:29.226098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:32.712464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:48.417610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:00:50.249Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 62 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "d9203503-5c13-4090-8f5a-3698f9081e5c" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.10:443 10.132.0.13:33266 - v1-completions-path 2026-10-30T03:00:51.336922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:00:52.557970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:00:52.558009Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:00:52.558021Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:00:52.558026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:00:52.482Z] "DELETE /v1/api-keys/a168a638-33f4-433c-ac06-9d7bbe7b4703 HTTP/1.1" 404 - via_upstream - "-" 0 29 75 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "45d7ef54-0478-4131-8951-fed0f622b58a" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.10:52162 10.132.1.10:443 10.132.0.13:33280 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:00:59.359851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:01:17.362660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:01:27.555455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:01:43.647403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:01:46.451951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:03:21.518524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:03:25.029689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:04:50.489480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:04:53.816266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:04:53.816309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:04:53.816329Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T03:04:53.816335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T03:04:53.736Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 79 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "394a8050-e2ad-4d89-baff-605c237ebb01" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.10:52034 10.132.1.10:443 10.132.0.13:47904 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T03:05:05.837950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:05:08.370840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:05:15.835296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:05:32.785273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:05:35.847376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:05:51.601650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:06:02.117361Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:06:07.025562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:06:10.690Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 78 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "352afea3-6f29-4989-948b-470bed23a56c" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:36036 - v1-completions-path [2026-10-30T03:06:10.789Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "4c348a41-113c-4c2a-8d79-2ed930c76448" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:33754 10.132.1.10:443 10.132.0.13:36040 - v1-completions-path 2026-10-30T03:06:24.158872Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:06:29.024880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:06:32.639655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:06:38.113477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T03:06:38.125514Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:06:38.125592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:06:38.125611Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T03:06:38.125617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T03:06:38.042Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 309 83 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "7f851509-06a3-4143-80bd-48cf14c92d17" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.1.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.10:40482 10.132.1.10:443 10.132.0.13:38890 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T03:06:38.911Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 69 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "5048b789-54ca-402d-a258-8db2b656e4c6" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:38892 - v1-completions-path [2026-10-30T03:06:39.106Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 70 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "8f8ea01b-e280-4694-bad0-bd111b524968" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.10:443 10.132.0.13:38894 - v1-completions-path 2026-10-30T03:06:55.162548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:05.579379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:08.229009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:11.828246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:19.587366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T03:07:24.624Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 67 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "7e19fe81-0cb5-41dd-972c-f6f66821d3af" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:59674 - v1-completions-path [2026-10-30T03:07:25.441Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "db69e8fb-4670-4749-850a-bc25d7ccadc0" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "10.134.0.43:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.10:36074 10.132.1.10:443 10.132.0.13:59690 - v1-completions-path 2026-10-30T03:07:38.161448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:48.497917Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:50.871748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:07:59.344337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:03.116957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:06.208785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:24.392838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:26.804179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:45.057542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:08:55.445177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:05.898554Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:16.118009Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:26.338795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:36.722604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:46.968383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:09:57.329351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:10:07.781831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:10:17.920204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T03:10:22.680195Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T03:10:22.680226Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T03:10:22.680229Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T03:10:22.680233Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T03:10:22.651Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 29 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "bb7ade09-fc15-483e-9e19-c73c7cd87333" "maas.apps.d9958b971f0301cd3391.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.10:443 10.132.0.13:60706 - v1-completions-path