2026-11-01T06:12:06.485572Z info FLAG: --concurrency="0" 2026-11-01T06:12:06.485591Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T06:12:06.485595Z info FLAG: --help="false" 2026-11-01T06:12:06.485597Z info FLAG: --log_as_json="false" 2026-11-01T06:12:06.485600Z info FLAG: --log_caller="" 2026-11-01T06:12:06.485602Z info FLAG: --log_output_level="default:info" 2026-11-01T06:12:06.485604Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T06:12:06.485608Z info FLAG: --log_target="[stdout]" 2026-11-01T06:12:06.485610Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T06:12:06.485612Z info FLAG: --outlierLogPath="" 2026-11-01T06:12:06.485614Z info FLAG: --profiling="true" 2026-11-01T06:12:06.485616Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T06:12:06.485618Z info FLAG: --proxyLogLevel="warning" 2026-11-01T06:12:06.485620Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T06:12:06.485622Z info FLAG: --stsPort="0" 2026-11-01T06:12:06.485624Z info FLAG: --templateFile="" 2026-11-01T06:12:06.485626Z info FLAG: --tokenManagerPlugin="" 2026-11-01T06:12:06.485628Z info FLAG: --vklog="0" 2026-11-01T06:12:06.485631Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T06:12:06.485754Z info Proxy role ips=[10.132.0.130] type=router id=maas-default-gateway-openshift-default-58d898bd55-p22bd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T06:12:06.485818Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T06:12:06.486857Z info cpu limit detected as 2, setting concurrency 2026-11-01T06:12:06.487418Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T06:12:06.487431Z info JWT policy is third-party-jwt 2026-11-01T06:12:06.487434Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T06:12:06.488772Z info Starting default Istio SDS Server 2026-11-01T06:12:06.488815Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T06:12:06.488833Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T06:12:06.489227Z info Opening status port 15020 2026-11-01T06:12:06.490486Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T06:12:06.491296Z info sds Starting SDS grpc server 2026-11-01T06:12:06.491315Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T06:12:06.491932Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T06:12:06.492724Z info Starting proxy agent 2026-11-01T06:12:06.492756Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T06:12:06.557901Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T06:12:06.608652Z info cache generated new workload certificate resourceName=default latency=117.253279ms ttl=23h59m59.391352795s 2026-11-01T06:12:06.608692Z info cache Root cert has changed, start rotating root cert 2026-11-01T06:12:06.608732Z info cache returned workload trust anchor from cache ttl=23h59m59.391269261s 2026-11-01T06:12:06.715051Z info ads ADS: new connection for node:1 2026-11-01T06:12:06.715187Z info cache returned workload certificate from cache ttl=23h59m59.284815158s 2026-11-01T06:12:06.715579Z info ads ADS: new connection for node:2 2026-11-01T06:12:06.715648Z info cache returned workload trust anchor from cache ttl=23h59m59.284352771s 2026-11-01T06:12:06.806052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:15.216470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:16.158940Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:16.989944Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T06:12:17.413118Z info Readiness succeeded in 10.930041001s 2026-11-01T06:12:17.413442Z info Envoy proxy is ready 2026-11-01T06:12:26.118874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:35.289859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:12:51.866140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:03.468012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:06.589252Z info ads ADS: new connection for node:3 2026-11-01T06:13:06.589533Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:06.589572Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T06:13:10.264801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:13:49.417501Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:13:52.509Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 111 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "455d42e2-d9f8-4818-9bf3-4b6a20bdfd54" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.1.64:8000" outbound|54321||e2e-prio-pool-25304531-inference-pool-ip-eb3771a1.llm.svc.cluster.local 10.132.0.130:33234 10.132.0.130:443 10.132.0.14:45828 - v1-model-routing 2026-11-01T06:14:13.271230Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T06:14:13.324281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:18.142132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:14:18.031Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 98 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "e512ca19-319d-47ee-981e-68b68f5b40c1" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:46978 10.132.0.130:443 10.132.0.14:50960 - v1-completions-path 2026-11-01T06:14:32.853197Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:14:44.705800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:11.442268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:36.548213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:15:51.823171Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:00.268053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:15.699570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:16:20.500065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:16:24.516Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "4402352d-653a-4dfb-b121-0d63150c030c" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.130:443 10.132.0.14:58920 - v1-completions-path 2026-11-01T06:16:25.089513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:16:25.089549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:16:25.089562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:16:25.089566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T06:16:25.022Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 67 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "98f76dce-4e00-4663-9b69-4c022094ec12" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:58942 - v1-catch-all-path 2026-11-01T06:16:38.688767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:27.603024Z info ads ADS: new connection for node:4 2026-11-01T06:17:27.607706Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T06:17:27.607750Z info cache read certificate from file resource=file-root:system 2026-11-01T06:17:31.237329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:17:32.627320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:23.735304Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T06:19:23.776727Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:26.336278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:19:36.565357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:19:40.880Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 74 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "58b3ea9a-ca35-4228-b00c-a4690689ab19" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:39296 10.132.0.130:443 10.132.0.14:48094 - v1-completions-path [2026-11-01T06:19:41.268Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "6bc56ade-15f9-967a-8010-858016ebb8d8" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.130:443 10.132.0.14:48106 - v1-completions-path 2026-11-01T06:19:54.888921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:11.764647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:18.853701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-01T06:20:18.795Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "7a040582-8f76-4410-ae73-94399346425a" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:47458 - v1-completions-path [2026-11-01T06:20:19.055Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "df710313-5016-4c0c-b482-358c4d6e1ee9" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:47462 - v1-completions-path [2026-11-01T06:20:22.872Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "203b508a-02d2-4136-8978-1964901632d5" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:47472 - v1-completions-path 2026-11-01T06:20:42.485272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:53.035710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:20:59.452156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:28.076072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:32.651946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:45.942039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:21:55.898982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:22:15.150Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 66 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "39258788-4a6a-400b-acdf-b029512bc4f3" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:46978 10.132.0.130:443 10.132.0.14:51912 - v1-completions-path 2026-11-01T06:22:19.596444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:30.194683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:48.179729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:22:54.319839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:12.503710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:17.912176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:29.222398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:23:55.970519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:06.682874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:24:54.868239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:25:02.477533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:27:16.533324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:28:23.192842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:28:23.192879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T06:28:23.192894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T06:28:23.192899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T06:28:23.073Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 119 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "a3d4e376-f221-41f5-b635-51e8ded30414" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.130:37438 10.132.0.130:443 10.132.0.14:45498 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T06:28:45.023250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:04.526832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:09.504499Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:21.374647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:38.132082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:29:43.033864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:02.734711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:13.388231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:19.925865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:48.887092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:30:55.328998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:01.243226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T06:31:15.575Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 65 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "5b34610c-a4d7-479d-8384-615351836cea" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:39296 10.132.0.130:443 10.132.0.14:57594 - v1-completions-path [2026-11-01T06:31:15.936Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 63 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "5a167778-0e76-4575-a5d7-2a3aa1da0988" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:57598 - v1-completions-path 2026-11-01T06:31:17.791059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T06:31:17.732Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "65596fd0-1cac-43ab-9be7-573d65b33752" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:39296 10.132.0.130:443 10.132.0.14:57614 - v1-completions-path 2026-11-01T06:31:33.401537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:44.114714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:50.705995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:31:56.542478Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:04.961974Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:32:04.962011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:32:04.962026Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T06:32:04.962031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T06:32:04.834Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 128 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "001332b6-226a-42ac-ab4a-511cc13e700d" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.132.0.132:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.130:52944 10.132.0.130:443 10.132.0.14:42370 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T06:32:05.165Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "4bc32719-4357-4b19-a6c5-38e349175734" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:52388 10.132.0.130:443 10.132.0.14:42380 - v1-completions-path 2026-11-01T06:32:08.557859Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:32.220591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:42.884458Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:32:47.610446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:05.803023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:11.907901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:35.591686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:33:57.632113Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:17.536182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:28.419886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:39.356155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:34:50.302769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:01.001198Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:11.817006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:22.568058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:33.204543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T06:35:39.195345Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:35:39.195374Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:35:39.195378Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T06:35:39.195383Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T06:35:39.171Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 24 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "f3968aa5-ae28-4da9-8328-d98701d1e768" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.130:443 10.132.0.14:50784 - v1-completions-path [2026-11-01T06:35:43.926Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 78 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "377ef4cb-f96d-440c-9f4d-36ac0d0fca96" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.130:46978 10.132.0.130:443 10.132.0.14:50810 - v1-completions-path [2026-11-01T06:35:44.473Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 38 - "44.212.242.249,10.132.0.14" "python-requests/2.33.0" "65fa2f89-cf45-48b4-932a-97d00f026df4" "maas.apps.eda98aafc97c4de12f32.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.130:443 10.132.0.14:50814 - v1-completions-path