2026-11-01T10:04:36.840023Z info FLAG: --concurrency="0" 2026-11-01T10:04:36.840041Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T10:04:36.840045Z info FLAG: --help="false" 2026-11-01T10:04:36.840047Z info FLAG: --log_as_json="false" 2026-11-01T10:04:36.840049Z info FLAG: --log_caller="" 2026-11-01T10:04:36.840051Z info FLAG: --log_output_level="default:info" 2026-11-01T10:04:36.840054Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T10:04:36.840058Z info FLAG: --log_target="[stdout]" 2026-11-01T10:04:36.840061Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T10:04:36.840063Z info FLAG: --outlierLogPath="" 2026-11-01T10:04:36.840065Z info FLAG: --profiling="true" 2026-11-01T10:04:36.840067Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T10:04:36.840069Z info FLAG: --proxyLogLevel="warning" 2026-11-01T10:04:36.840071Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T10:04:36.840073Z info FLAG: --stsPort="0" 2026-11-01T10:04:36.840075Z info FLAG: --templateFile="" 2026-11-01T10:04:36.840077Z info FLAG: --tokenManagerPlugin="" 2026-11-01T10:04:36.840080Z info FLAG: --vklog="0" 2026-11-01T10:04:36.840082Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T10:04:36.840220Z info Proxy role ips=[10.132.1.117] type=router id=maas-default-gateway-openshift-default-746ff8f49f-n4qzc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T10:04:36.840268Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T10:04:36.841736Z info cpu limit detected as 2, setting concurrency 2026-11-01T10:04:36.842036Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T10:04:36.842047Z info JWT policy is third-party-jwt 2026-11-01T10:04:36.842052Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T10:04:36.843924Z info Starting default Istio SDS Server 2026-11-01T10:04:36.843952Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T10:04:36.843976Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T10:04:36.844346Z info Opening status port 15020 2026-11-01T10:04:36.845315Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T10:04:36.846280Z info sds Starting SDS grpc server 2026-11-01T10:04:36.846297Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T10:04:36.847058Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T10:04:36.848141Z info Starting proxy agent 2026-11-01T10:04:36.848178Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T10:04:36.921797Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T10:04:37.088660Z info cache generated new workload certificate resourceName=default latency=242.249049ms ttl=23h59m59.911344988s 2026-11-01T10:04:37.088699Z info cache Root cert has changed, start rotating root cert 2026-11-01T10:04:37.088732Z info cache returned workload trust anchor from cache ttl=23h59m59.911268221s 2026-11-01T10:04:37.101321Z info ads ADS: new connection for node:1 2026-11-01T10:04:37.101390Z info cache returned workload certificate from cache ttl=23h59m59.898612211s 2026-11-01T10:04:37.101583Z info ads ADS: new connection for node:2 2026-11-01T10:04:37.101668Z info cache returned workload trust anchor from cache ttl=23h59m59.898334128s 2026-11-01T10:04:37.184404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:04:46.133628Z info Readiness succeeded in 9.29665845s 2026-11-01T10:04:46.134074Z info Envoy proxy is ready 2026-11-01T10:04:59.936373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:05:04.781Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 382 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "b3efac13-514b-4849-be51-e9cd503a3dc0" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.132.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:40952 10.132.1.117:443 10.133.0.18:43470 - v1-chat-completions-path [2026-11-01T10:05:05.551Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 65 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "a6f3b9d2-f79d-4e33-8a9e-42cfd20fbb3a" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.132.0.31:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:40952 10.132.1.117:443 10.133.0.18:37386 - v1-chat-completions-path 2026-11-01T10:05:19.291390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:05:23.940426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:05:33.966269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:05:38.300465Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T10:05:38.207Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 92 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "7762a363-c6ae-4e95-918a-8d326a907d70" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:48238 10.132.1.117:443 10.133.0.18:51946 - v1-catch-all-path [2026-11-01T10:05:39.396Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 65 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "1c52ae99-e756-4304-b6dc-6a4fafa65928" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.117:443 10.133.0.18:51952 - v1-catch-all-path 2026-11-01T10:05:45.354507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:05:55.023762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:06:12.748249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:06:24.409446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:06:27.145996Z info ads ADS: new connection for node:3 2026-11-01T10:06:27.146174Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T10:06:27.146205Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T10:06:31.156044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:07:10.219245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:07:35.512875Z info ads ADS: "" 3 terminated 2026-11-01T10:07:35.574326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:07:41.939958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:07:54.486860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:10:31.377909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:10:58.882373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:11:29.053697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:11:42.676895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:11:48.698285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:11:53.879456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:12:06.812655Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:12:14.344828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:12:18.161139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T10:12:17.978Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 182 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "979977e3-4196-46ec-ae22-ccd26cfff490" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.133.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.117:53224 10.132.1.117:443 10.133.0.18:60718 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T10:12:19.730010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T10:12:19.676Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 53 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "6d15f133-f7d5-4865-ab68-6cc745dcd6f6" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.133.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.117:53224 10.132.1.117:443 10.133.0.18:60728 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T10:12:33.145862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:12:55.988Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 82 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "98cbf0c6-f5a3-43a2-bafe-7c9438e58674" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:56178 10.132.1.117:443 10.133.0.18:48530 - v1-completions-path 2026-11-01T10:13:26.506354Z info ads ADS: new connection for node:4 2026-11-01T10:13:26.511259Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T10:13:26.511307Z info cache read certificate from file resource=file-root:system 2026-11-01T10:13:30.432149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:13:31.207986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:13:51.409234Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T10:13:51.409520Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T10:13:51.207Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 201 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "de44203c-d400-40ea-99ae-37feb62d6568" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.117:49440 10.132.1.117:443 10.133.0.18:45070 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T10:14:06.407381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T10:14:06.407673Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T10:14:06.272Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1709 135 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "1d1e5ced-e8b9-4d46-8117-da16353e3cf5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.117:49440 10.132.1.117:443 10.133.0.18:37210 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T10:14:18.982165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T10:14:18.982463Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T10:14:18.739Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 243 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "2783f64f-8c56-41f9-bfa0-87a88be8a730" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.117:53954 10.132.1.117:443 10.133.0.18:35624 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T10:14:26.133876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T10:14:26.134125Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T10:14:25.997Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 136 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "bc2fc185-0f2e-417f-9ef7-720a17f8d8e0" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.117:49440 10.132.1.117:443 10.133.0.18:44268 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T10:15:31.381506Z info ads ADS: "" 4 terminated 2026-11-01T10:15:31.422995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:15:33.904108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:15:44.223466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:16:03.477719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:16:09.521953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:16:14.209Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "62929c3a-06bc-478c-81f4-00662dc1267b" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.117:443 10.133.0.18:47814 - v1-completions-path 2026-11-01T10:16:14.607441Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T10:16:14.607470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T10:16:14.530Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 77 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "3cc6a49b-16a6-4fd7-8e98-b3a2a6875030" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:50092 10.132.1.117:443 10.133.0.18:47830 - v1-catch-all-path 2026-11-01T10:16:31.349723Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:16:44.749739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:16:52.084Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "fdc54775-dba5-4959-b200-43c04484fc44" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:44756 10.132.1.117:443 10.133.0.18:42458 - v1-completions-path 2026-11-01T10:17:15.869915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:17:26.492334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:17:32.650819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:17:47.561Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 65 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "8add15e8-bcd8-4a22-ae0e-b3befbf3d836" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:50092 10.132.1.117:443 10.133.0.18:45948 - v1-completions-path 2026-11-01T10:18:01.201820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:05.720243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:18.626950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:27.261732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:36.328915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:44.995401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:18:54.050025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:19:11.480961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:19:17.302205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:19:36.195096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:19:41.403700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:19:53.866760Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:20:13.694863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:20:24.427318Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:20:27.616007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T10:20:27.491Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 124 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "199b941e-453a-4fba-a01a-5a5d3c3ffbef" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.133.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.117:40430 10.132.1.117:443 10.133.0.18:34160 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T10:20:42.836555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:20:50.268871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:22:55.479403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:24:25.121450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:24:30.914Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 286 79 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "f48698a9-00cc-4099-9c1b-0c409fc50eca" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.132.0.30:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:36612 10.132.1.117:443 10.133.0.18:33466 - v1-completions-path 2026-11-01T10:24:45.531154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:24:50.705654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:25:04.255859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:25:18.032228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:25:23.183206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:25:28.316755Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-01T10:25:28.309Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 67 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "a8b4cee2-edd7-4164-b4b7-ece5deab70f9" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:44756 10.132.1.117:443 10.133.0.18:56216 - v1-completions-path 2026-11-01T10:25:44.053884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:25:54.737970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:26:01.314373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:26:16.627Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 73 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "e84427a0-002b-4749-8e1a-d3167af44cbc" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:50092 10.132.1.117:443 10.133.0.18:47690 - v1-completions-path 2026-11-01T10:26:31.504884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:26:38.124851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:26:44.306363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:26:54.845Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "d85ae843-062f-4573-9adf-abf495b894ff" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.117:443 10.133.0.18:55322 - v1-completions-path 2026-11-01T10:27:16.233449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:27:26.836070Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:27:31.919697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:27:38.128580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:27:49.483897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T10:27:58.312Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 71 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "73ecc477-2852-406d-accf-812851039c26" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.117:44756 10.132.1.117:443 10.133.0.18:44130 - v1-completions-path 2026-11-01T10:27:59.435975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T10:27:59.294Z] "DELETE /v1/api-keys/8a260b8f-da59-44e9-a768-b211c185ab40 HTTP/1.1" 200 - via_upstream - "-" 0 367 141 - "52.71.36.72,10.133.0.18" "python-requests/2.34.2" "4ba34079-da19-9071-9043-7b307d276179" "maas.apps.97301875ced6cd69e07a.prod.konflux-ocp-ci.dev" "10.134.1.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.117:56866 10.132.1.117:443 10.133.0.18:44146 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T10:28:12.917593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:28:23.672642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:28:28.660934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:28:46.639069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:28:52.908678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:29:16.917567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:29:36.965924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:29:47.863107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:29:58.821373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:30:09.820086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:30:20.601192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:30:31.537187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:30:42.310677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:30:53.061435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:31:03.867173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T10:31:14.495836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8