2026-11-04T01:33:48.227562Z info FLAG: --concurrency="0" 2026-11-04T01:33:48.227580Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:33:48.227584Z info FLAG: --help="false" 2026-11-04T01:33:48.227587Z info FLAG: --log_as_json="false" 2026-11-04T01:33:48.227589Z info FLAG: --log_caller="" 2026-11-04T01:33:48.227591Z info FLAG: --log_output_level="default:info" 2026-11-04T01:33:48.227593Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:33:48.227597Z info FLAG: --log_target="[stdout]" 2026-11-04T01:33:48.227599Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:33:48.227601Z info FLAG: --outlierLogPath="" 2026-11-04T01:33:48.227603Z info FLAG: --profiling="true" 2026-11-04T01:33:48.227605Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:33:48.227607Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:33:48.227610Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:33:48.227612Z info FLAG: --stsPort="0" 2026-11-04T01:33:48.227614Z info FLAG: --templateFile="" 2026-11-04T01:33:48.227616Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:33:48.227618Z info FLAG: --vklog="0" 2026-11-04T01:33:48.227621Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:33:48.227761Z info Proxy role ips=[10.134.0.216] type=router id=maas-default-gateway-openshift-default-5d84bc6b95-tbtsh.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:33:48.227810Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:33:48.228867Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:33:48.229056Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:33:48.229066Z info JWT policy is third-party-jwt 2026-11-04T01:33:48.229069Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:33:48.231000Z info Starting default Istio SDS Server 2026-11-04T01:33:48.231027Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:33:48.231051Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:33:48.231421Z info Opening status port 15020 2026-11-04T01:33:48.232262Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:33:48.233589Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:33:48.234347Z info Starting proxy agent 2026-11-04T01:33:48.234399Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:33:48.243880Z info sds Starting SDS grpc server 2026-11-04T01:33:48.243896Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:33:48.298345Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:33:48.382771Z info cache generated new workload certificate resourceName=default latency=150.187055ms ttl=23h59m59.617233869s 2026-11-04T01:33:48.382812Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:33:48.382846Z info cache returned workload trust anchor from cache ttl=23h59m59.617154079s 2026-11-04T01:33:48.443990Z info ads ADS: new connection for node:1 2026-11-04T01:33:48.444047Z info cache returned workload certificate from cache ttl=23h59m59.555954509s 2026-11-04T01:33:48.444734Z info ads ADS: new connection for node:2 2026-11-04T01:33:48.444805Z info cache returned workload trust anchor from cache ttl=23h59m59.555196552s 2026-11-04T01:33:48.528854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:33:56.531065Z info Readiness succeeded in 8.305756955s 2026-11-04T01:33:56.531479Z info Envoy proxy is ready 2026-11-04T01:33:57.135846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:06.914885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:23.158844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:35.105424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:34:37.895069Z info ads ADS: new connection for node:3 2026-11-04T01:34:37.895277Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:34:37.895359Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-04T01:34:40.522068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:21.359741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:45.782479Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T01:35:46.142244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:35:51.467177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:36:08.213127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:38:42.482439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:10.841392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:30.466952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:44.517188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:39:51.542035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:40:02.444286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:40:07.553720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:40:25.680548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:41:11.823Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 88 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9fe38ed8-5e79-4a73-9335-ef892af4884b" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51772 10.134.0.216:443 10.132.0.9:60388 - v1-completions-path 2026-11-04T01:41:13.758475Z info ads ADS: new connection for node:4 2026-11-04T01:41:13.763592Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:41:13.763649Z info cache read certificate from file resource=file-root:system 2026-11-04T01:41:17.331476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:18.850502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:41:52.749081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:41:52.749114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:41:52.749124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:41:52.749128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:41:52.749279Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:41:52.546Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1529 203 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4640360d-1fed-40fe-8cf9-bf4152a59816" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.216:53036 10.134.0.216:443 10.132.0.9:34596 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:23.866826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:23.866857Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:23.866866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:42:23.866870Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:23.867023Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:42:23.735Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1534 131 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "eabc4a7a-d1ca-471d-9775-4062b618d0c1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.216:53036 10.134.0.216:443 10.132.0.9:45686 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:35.524886Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T01:42:35.525207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:35.525229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:35.525239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:42:35.525244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:42:35.525421Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:42:35.403Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1535 122 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "37ffe979-dd46-42a0-951c-9a9d24f5f7f5" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.216:53036 10.134.0.216:443 10.132.0.9:55730 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-04T01:42:55.620949Z info ads ADS: "" 4 terminated 2026-11-04T01:42:56.073248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:42:56.073288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:42:56.073304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:42:56.073311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T01:42:55.957Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 116 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "8ecd8e02-44cc-4d02-80dc-55b0d72b676c" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.216:43708 10.134.0.216:443 10.132.0.9:42116 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:42:57.134919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:42:58.400062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:00.413067Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:43:00.413093Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:43:00.413097Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T01:43:00.413101Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T01:43:00.376Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 36 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f6258cde-9741-4be6-9975-e641e888c784" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.216:443 10.132.0.9:42130 - v1-completions-path 2026-11-04T01:43:09.319621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:27.805776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:43:32.685572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:43:36.674Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 71 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "78f9e19b-0a74-490f-bc4d-e2d6b390543a" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:34212 - v1-completions-path [2026-11-04T01:43:36.928Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ff7d7939-ab1e-4cbc-9176-9f2f0a33eb61" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51496 10.134.0.216:443 10.132.0.9:34220 - v1-completions-path [2026-11-04T01:43:39.601Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "999f05a0-8165-45f7-9dfa-ce934b88499b" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.216:443 10.132.0.9:34248 - v1-completions-path 2026-11-04T01:43:57.274820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:10.463250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:44:18.261Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "140b4c89-2903-4970-95af-0943f5b54f9e" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51496 10.134.0.216:443 10.132.0.9:47178 - v1-completions-path 2026-11-04T01:44:20.801157Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-04T01:44:20.747Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "d4571772-15e7-46cb-ae33-ed9d6e9abd02" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:40048 - v1-completions-path [2026-11-04T01:44:21.246Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c3431778-abc7-46ab-b61a-e04380b7d628" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:40062 - v1-completions-path [2026-11-04T01:44:21.830Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "98dc1888-93f4-458b-9abd-bb1064a36d92" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:40066 - v1-completions-path 2026-11-04T01:44:41.601006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:52.304457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:44:57.425146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:45:10.958Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "91d78ce1-65d1-47a7-8e3c-becff6026879" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:48138 - v1-completions-path [2026-11-04T01:45:11.748Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "afecd95b-009a-4109-a783-4c7f722e436c" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51496 10.134.0.216:443 10.132.0.9:48140 - v1-completions-path 2026-11-04T01:45:26.971164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:31.943656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:45:46.073321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:45:50.229Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 67 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b16c8536-8520-4dc5-af53-ab9ba717e0fc" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51772 10.134.0.216:443 10.132.0.9:50020 - v1-completions-path 2026-11-04T01:45:55.513129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:03.582174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:46:07.668Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 71 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "99ed7bed-68cc-437d-bf38-6a5dea8bcc3b" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51772 10.134.0.216:443 10.132.0.9:34594 - v1-completions-path 2026-11-04T01:46:12.931291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:46:22.667329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:46:25.643Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9d8bf6dc-c17f-498e-a0ce-3f6bfb702a94" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:32800 10.134.0.216:443 10.132.0.9:54180 - v1-completions-path 2026-11-04T01:46:41.235065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:12.741297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:21.666305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:47:21.666342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:47:21.666355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:47:21.666360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T01:47:21.554Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 112 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "53ea37e4-bc0a-4277-9ed4-c74925022ae3" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.216:59606 10.134.0.216:443 10.132.0.9:38384 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:47:36.141150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:47:46.869779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:52:23.961505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:52:23.961539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T01:52:23.961554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T01:52:23.961559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T01:52:23.846Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 115 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e5e05c16-97b5-4486-be1e-9328d83e4a8f" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.216:37624 10.134.0.216:443 10.132.0.9:38752 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:52:24.221482Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:52:24.221504Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:52:24.221507Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T01:52:24.221511Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T01:52:24.177Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 43 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "400e2d25-9197-480e-bb6f-dd47636a3616" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.216:443 10.132.0.9:38756 - v1-completions-path 2026-11-04T01:52:47.826408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:05.036626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:09.623762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:22.331304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:39.990607Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:53:46.507438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:05.968265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:16.660237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:22.869542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:54:35.537Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "80773a98-6a39-4743-b71c-29d410302540" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:47326 - v1-completions-path 2026-11-04T01:54:50.774332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:56.909871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:02.776425Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:55:11.435Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "aad34aa0-9e2f-42b3-94f7-281335564751" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:53286 - v1-completions-path [2026-11-04T01:55:12.582Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "fd88e4dd-8ce0-41af-8260-6440e140eeb6" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51488 10.134.0.216:443 10.132.0.9:53294 - v1-completions-path [2026-11-04T01:55:18.084Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6b140a4a-4d07-4b6b-b198-eb10d7272db2" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:51496 10.134.0.216:443 10.132.0.9:53306 - v1-completions-path 2026-11-04T01:55:34.482925Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:45.272130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:51.719866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:55:59.285743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:10.456836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:33.851527Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:44.669044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:56:49.466731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:07.824161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:13.931192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:36.011011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:57:57.843574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:18.173811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:30.654519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:50.681983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:01.589248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:12.336816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:23.164793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:33.759305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T01:59:39.726Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 114 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "972d5460-e760-4c01-bafd-98f691fc10b4" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:32800 10.134.0.216:443 10.132.0.9:56156 - v1-completions-path [2026-11-04T01:59:45.837Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 133 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "757bdd8a-b2c8-4112-8070-8dc2e72a46e7" "maas.apps.34861718878ef819d16d.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.216:32800 10.134.0.216:443 10.132.0.9:48542 - v1-completions-path