2026-11-01T15:46:00.968614Z info FLAG: --concurrency="0" 2026-11-01T15:46:00.968634Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T15:46:00.968638Z info FLAG: --help="false" 2026-11-01T15:46:00.968641Z info FLAG: --log_as_json="false" 2026-11-01T15:46:00.968643Z info FLAG: --log_caller="" 2026-11-01T15:46:00.968645Z info FLAG: --log_output_level="default:info" 2026-11-01T15:46:00.968647Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T15:46:00.968653Z info FLAG: --log_target="[stdout]" 2026-11-01T15:46:00.968655Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T15:46:00.968658Z info FLAG: --outlierLogPath="" 2026-11-01T15:46:00.968660Z info FLAG: --profiling="true" 2026-11-01T15:46:00.968662Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T15:46:00.968664Z info FLAG: --proxyLogLevel="warning" 2026-11-01T15:46:00.968666Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T15:46:00.968668Z info FLAG: --stsPort="0" 2026-11-01T15:46:00.968670Z info FLAG: --templateFile="" 2026-11-01T15:46:00.968672Z info FLAG: --tokenManagerPlugin="" 2026-11-01T15:46:00.968675Z info FLAG: --vklog="0" 2026-11-01T15:46:00.968678Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T15:46:00.968822Z info Proxy role ips=[10.132.0.149] type=router id=maas-default-gateway-openshift-default-7f5667f86c-q9j4g.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T15:46:00.968866Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T15:46:00.970288Z info cpu limit detected as 2, setting concurrency 2026-11-01T15:46:00.970488Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T15:46:00.970505Z info JWT policy is third-party-jwt 2026-11-01T15:46:00.970508Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T15:46:00.972115Z info Starting default Istio SDS Server 2026-11-01T15:46:00.972138Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T15:46:00.972161Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T15:46:00.972425Z info Opening status port 15020 2026-11-01T15:46:00.973222Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T15:46:00.973908Z info sds Starting SDS grpc server 2026-11-01T15:46:00.973945Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T15:46:00.974528Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T15:46:00.975349Z info Starting proxy agent 2026-11-01T15:46:00.975380Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T15:46:01.039019Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T15:46:01.087586Z info cache generated new workload certificate resourceName=default latency=113.532234ms ttl=23h59m59.912420714s 2026-11-01T15:46:01.087632Z info cache Root cert has changed, start rotating root cert 2026-11-01T15:46:01.087679Z info cache returned workload trust anchor from cache ttl=23h59m59.912321611s 2026-11-01T15:46:01.181788Z info ads ADS: new connection for node:1 2026-11-01T15:46:01.181862Z info cache returned workload certificate from cache ttl=23h59m59.818140793s 2026-11-01T15:46:01.182011Z info ads ADS: new connection for node:2 2026-11-01T15:46:01.182085Z info cache returned workload trust anchor from cache ttl=23h59m59.817916514s 2026-11-01T15:46:01.262158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:09.129746Z info Readiness succeeded in 8.163496639s 2026-11-01T15:46:09.130074Z info Envoy proxy is ready 2026-11-01T15:46:25.488763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:27.971803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:46:27.971843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:46:27.971858Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:46:27.971863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T15:46:27.842Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 61 303 129 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "89652ac3-fe39-4bca-a1cd-666ab35d6912" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:53392 10.132.0.149:443 10.132.0.15:48656 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T15:46:28.531Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 2817 3089 75 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "895349f9-bfd3-4994-8e15-4bd6d3df39cc" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:39186 10.132.0.149:443 10.132.0.15:48666 - v1-chat-completions-path 2026-11-01T15:46:44.331223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:48.932805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:52.450859Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-01T15:46:52.361Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 89 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b6d65f0e-65ed-4af6-9eb2-fb6d03feacae" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:39376 10.132.0.149:443 10.132.0.15:36562 - v1-catch-all-path 2026-11-01T15:46:57.638084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:00.978068Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T15:47:00.919Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "6d08755f-bb82-4519-9168-68bcc007daf4" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:58434 10.132.0.149:443 10.132.0.15:43026 - v1-catch-all-path 2026-11-01T15:47:01.319854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T15:47:01.324309Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T15:47:01.266Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "16207ce8-7a36-486d-8f73-45c2955d98ba" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:58434 10.132.0.149:443 10.132.0.15:43040 - v1-catch-all-path 2026-11-01T15:47:10.311746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:18.851250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:35.747905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:47.369955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:50.722395Z info ads ADS: new connection for node:3 2026-11-01T15:47:50.722589Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T15:47:50.722616Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T15:47:53.804350Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:48:33.046416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T15:48:41.421Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 345 90 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "eeb799a9-e230-4742-99be-10f225642817" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.247:8000" outbound|54321||e2e-prio-pool-4dbaa3d3-inference-pool-ip-2b0eb45f.llm.svc.cluster.local 10.132.0.149:52582 10.132.0.149:443 10.132.0.15:60932 - v1-model-routing 2026-11-01T15:48:58.814764Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T15:48:59.108656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:49:03.690335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:49:17.452858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:51:50.773455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:20.378119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:37.533558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:52:37.533595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:52:37.533610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:52:37.533615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T15:52:37.414Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 119 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c6e7c21e-e5bb-4bd6-bc56-623631858044" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:58452 10.132.0.149:443 10.132.0.15:44038 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T15:52:39.782043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:54.929226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:01.114364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:12.444334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:16.998683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T15:53:20.443Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 73 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "687c31c4-8358-41bd-9132-44057f87bfa8" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:52424 - v1-completions-path 2026-11-01T15:53:36.002734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:57:04.151396Z info ads ADS: new connection for node:4 2026-11-01T15:57:04.156878Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T15:57:04.156926Z info cache read certificate from file resource=file-root:system 2026-11-01T15:57:07.532712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:57:08.789026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:57:28.238074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:57:28.238109Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:57:28.238119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:57:28.238124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T15:57:28.238305Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T15:57:28.048Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 189 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "ae3f29a5-ced5-4732-91f8-0e2980fa2e3c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.149:37864 10.132.0.149:443 10.132.0.15:32772 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T15:58:50.105240Z info ads ADS: "" 4 terminated 2026-11-01T15:58:50.146779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:58:52.536104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:58:54.304607Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T15:58:54.304637Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T15:58:54.304641Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T15:58:54.304646Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T15:58:54.262Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 42 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "44a8222c-1619-41e6-b7c1-56411c432311" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.149:443 10.132.0.15:56330 - v1-completions-path 2026-11-01T15:59:02.281673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:04.881584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:59:04.881621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:59:04.881637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T15:59:04.881642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T15:59:04.754Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 126 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "f30891fd-fcc0-4664-9974-3ef3a080033a" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.149:51908 10.132.0.149:443 10.132.0.15:56946 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T15:59:06.204Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "41a9a51e-c926-44cd-9601-e5676e181ad6" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:56952 - v1-completions-path 2026-11-01T15:59:20.315609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:26.313732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:49.424841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:02.515756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:00:11.689Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "f22b32b1-490a-4ba9-aee9-a63dfc78abee" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:46774 - v1-completions-path 2026-11-01T16:00:32.789463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:43.429715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:49.428666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:01:02.606Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "4f5d970a-18e6-49dc-9144-e77671cc6ae8" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:38880 - v1-completions-path 2026-11-01T16:01:18.164408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:22.539454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:35.130860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:43.477720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:50.787983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:59.446616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:02:08.165868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:02:27.504742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:02:30.293Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 71 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "e1105f0f-dab6-4358-94d4-2bdbf4762c95" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:60496 10.132.0.149:443 10.132.0.15:34452 - v1-completions-path 2026-11-01T16:02:56.582934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:03:17.960207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:03:28.657242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:07:24.464121Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T16:07:24.464150Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T16:07:24.464154Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T16:07:24.464159Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T16:07:24.418Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 45 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "7e65472a-5445-4f80-9194-41d3f7eb1056" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.149:443 10.132.0.15:32958 - v1-completions-path 2026-11-01T16:07:50.344444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:07.230498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:11.397714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:23.721966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:40.719451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:47.134584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:08:50.119Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 77 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "5c80dda1-3696-4a3d-a2ae-10a93ba5469a" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:45696 10.132.0.149:443 10.132.0.15:36780 - v1-completions-path 2026-11-01T16:09:06.514390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:17.096202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:23.152342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:09:35.649Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b1521357-8694-4f81-9fc7-2d8153a3fbc6" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:52110 - v1-completions-path 2026-11-01T16:09:50.254593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:56.127241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:01.735403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:09.766484Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T16:10:09.711Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "351f3f2a-83ab-4961-923c-13c8d353ccd3" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:45696 10.132.0.149:443 10.132.0.15:52422 - v1-completions-path [2026-11-01T16:10:10.302Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "5380b425-5461-48ae-b8ae-6e2a9bad5890" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:45696 10.132.0.149:443 10.132.0.15:52426 - v1-completions-path [2026-11-01T16:10:14.126Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "1d15f5ea-72da-426b-8599-f4ebcaa4317c" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:52446 - v1-completions-path [2026-11-01T16:10:14.493Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d5b8974f-2cff-4ce8-9524-c6216797089b" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:45696 10.132.0.149:443 10.132.0.15:52452 - v1-completions-path [2026-11-01T16:10:18.430Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "6c8827d5-de8d-42d3-bc65-ac2c64668720" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.149:443 10.132.0.15:52472 - v1-completions-path 2026-11-01T16:10:32.425074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:43.139485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:49.260278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:54.992854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:11:05.260055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:11:13.028Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "ffae67fc-a66c-4c8f-bdaf-500135da926a" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.149:33534 10.132.0.149:443 10.132.0.15:58846 - v1-completions-path 2026-11-01T16:11:28.626947Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:11:39.359373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:11:44.045922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:01.890812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:07.828956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:17.768498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:39.324243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:59.290556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:10.247912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:21.011084Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:32.033129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:42.761222Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:53.495150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:04.370691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:14.982969Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:25.650589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:27.765211Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T16:14:27.765237Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T16:14:27.765240Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-01T16:14:27.765243Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-01T16:14:27.742Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "30ca3513-4b2a-4aca-ba7d-bc5998948978" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.149:443 10.132.0.15:45764 - v1-completions-path