2026-11-03T01:18:59.204194Z info FLAG: --concurrency="0" 2026-11-03T01:18:59.204216Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T01:18:59.204221Z info FLAG: --help="false" 2026-11-03T01:18:59.204225Z info FLAG: --log_as_json="false" 2026-11-03T01:18:59.204228Z info FLAG: --log_caller="" 2026-11-03T01:18:59.204231Z info FLAG: --log_output_level="default:info" 2026-11-03T01:18:59.204233Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T01:18:59.204239Z info FLAG: --log_target="[stdout]" 2026-11-03T01:18:59.204243Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T01:18:59.204246Z info FLAG: --outlierLogPath="" 2026-11-03T01:18:59.204267Z info FLAG: --profiling="true" 2026-11-03T01:18:59.204271Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T01:18:59.204275Z info FLAG: --proxyLogLevel="warning" 2026-11-03T01:18:59.204277Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T01:18:59.204281Z info FLAG: --stsPort="0" 2026-11-03T01:18:59.204284Z info FLAG: --templateFile="" 2026-11-03T01:18:59.204287Z info FLAG: --tokenManagerPlugin="" 2026-11-03T01:18:59.204291Z info FLAG: --vklog="0" 2026-11-03T01:18:59.204294Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T01:18:59.204519Z info Proxy role ips=[10.134.1.54] type=router id=maas-default-gateway-openshift-default-6cc458d887-w99jj.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T01:18:59.204581Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T01:18:59.205649Z info cpu limit detected as 2, setting concurrency 2026-11-03T01:18:59.205875Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T01:18:59.205888Z info JWT policy is third-party-jwt 2026-11-03T01:18:59.205893Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T01:18:59.207720Z info Starting default Istio SDS Server 2026-11-03T01:18:59.207746Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T01:18:59.207770Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T01:18:59.208019Z info Opening status port 15020 2026-11-03T01:18:59.209027Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T01:18:59.210436Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T01:18:59.211547Z info Starting proxy agent 2026-11-03T01:18:59.211581Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T01:18:59.220172Z info sds Starting SDS grpc server 2026-11-03T01:18:59.220197Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T01:18:59.277021Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T01:18:59.376237Z info cache generated new workload certificate resourceName=default latency=167.496586ms ttl=23h59m59.623767371s 2026-11-03T01:18:59.376299Z info cache Root cert has changed, start rotating root cert 2026-11-03T01:18:59.376333Z info cache returned workload trust anchor from cache ttl=23h59m59.623667663s 2026-11-03T01:18:59.400960Z info ads ADS: new connection for node:1 2026-11-03T01:18:59.401062Z info cache returned workload certificate from cache ttl=23h59m59.598941236s 2026-11-03T01:18:59.401529Z info ads ADS: new connection for node:2 2026-11-03T01:18:59.401622Z info cache returned workload trust anchor from cache ttl=23h59m59.598379436s 2026-11-03T01:18:59.491036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:07.778681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:08.824482Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T01:19:09.847754Z info Readiness succeeded in 10.64643812s 2026-11-03T01:19:09.848205Z info Envoy proxy is ready 2026-11-03T01:19:14.331566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:19:14.331604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:19:14.331615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T01:19:14.331620Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T01:19:14.228Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 103 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "830f7e6e-e9f9-4f65-b6db-59b6cb707306" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.54:49588 10.134.1.54:443 10.132.0.18:45060 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:19:37.170065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:52.953582Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:19:55.381660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:01.482435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:08.423174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:18.590365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:33.403295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:44.460161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:20:47.181015Z info ads ADS: new connection for node:3 2026-11-03T01:20:47.181219Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:20:47.181281Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:20:50.568417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:30.557597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:49.733025Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T01:21:49.788461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:52.160763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:21:54.912058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:22:00.083132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:16.721358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:32.746638Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:24:49.021738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:02.978914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:06.750180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:17.980951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:22.697141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:25:38.008237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:26:08.806Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 90 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "4b7d091e-7644-4103-bf2d-d41ff7b2c081" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:50630 10.134.1.54:443 10.132.0.18:40966 - v1-completions-path 2026-11-03T01:26:24.733059Z info ads ADS: new connection for node:4 2026-11-03T01:26:24.740798Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T01:26:24.740896Z info cache read certificate from file resource=file-root:system 2026-11-03T01:26:25.712062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:26:27.221572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:26:30.168152Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"138","StreamId":"3332055247290716835"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-11-03T01:26:30.101Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 66 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "328fef16-9bc6-40d9-9ad6-87684b0b0e56" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.134.1.54:443 10.132.0.18:55114 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T01:27:49.323655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:49.323693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:49.323705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:27:49.323709Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:27:49.323887Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:27:49.211Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 112 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "88f6e235-053c-4cf1-ab9c-609498e07ff1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.54:57578 10.134.1.54:443 10.132.0.18:55706 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:28:02.820688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:02.895981Z info ads ADS: "" 4 terminated 2026-11-03T01:28:04.207123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:10.997315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:26.742996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:31.201688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:28:46.228874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:29:02.086315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:29:06.442Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "a50034b8-c8e9-4026-b950-1083b2d73433" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:41226 - v1-completions-path [2026-11-03T01:29:07.284Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 60 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "79d79627-d34c-430a-b629-27a969ec2fa5" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.54:443 10.132.0.18:41230 - v1-completions-path [2026-11-03T01:29:07.636Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 73 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1045ac62-f18f-4f1e-ba20-a897cf889050" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49420 10.134.1.54:443 10.132.0.18:41234 - v1-completions-path 2026-11-03T01:29:24.641481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:29:48.146920Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T01:29:48.140Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "acc6fc35-a41a-4a0b-956a-cb5a50d6615d" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:39220 - v1-completions-path 2026-11-03T01:29:48.903881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T01:29:48.292Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 55 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "24b622ad-849c-4886-af05-b41b9928a241" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:39232 - v1-completions-path [2026-11-03T01:29:48.848Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "102ba8a8-874b-49b8-9401-c3e3564d1bdc" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49420 10.134.1.54:443 10.132.0.18:39234 - v1-completions-path 2026-11-03T01:30:11.539307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:20.810998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:25.935233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:34.462646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:39.508993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:30:58.056971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:00.997325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:31:03.227Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 65 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "651db54e-e979-4e7d-9789-f9393291aafc" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:48296 10.134.1.54:443 10.132.0.18:47556 - v1-completions-path 2026-11-03T01:31:15.938729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:18.885092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:26.838829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:45.036331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:31:55.526071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:32:12.372206Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:32:14.955292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:34:33.476577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:34:36.800887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:02.446043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:18.073391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:20.410876Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:27.583161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:45.249076Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:36:49.005024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:04.612856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:15.110418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:30.835158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:37:35.826Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 69 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "7adaf809-fdf4-4c93-994d-2e3a9f7e22da" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:48190 - v1-completions-path 2026-11-03T01:37:48.054117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:52.628620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:37:55.677433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:38:03.870Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "6364818f-6c5a-4a26-8923-d9e0201e69af" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:44980 - v1-completions-path [2026-11-03T01:38:04.962Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "6f15a363-ecbd-4dd8-8a97-561d7c784bf7" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49420 10.134.1.54:443 10.132.0.18:44994 - v1-completions-path [2026-11-03T01:38:05.140Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "c69f0f61-f0db-46e2-b112-1b087bbff1b9" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:44998 - v1-completions-path [2026-11-03T01:38:05.871Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "487fad05-520a-4a0d-9d79-8a4355429b6c" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:49418 10.134.1.54:443 10.132.0.18:45020 - v1-completions-path 2026-11-03T01:38:18.897716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:29.153455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:33.713865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:37.294412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:38:42.065563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:00.603405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:11.057839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:13.415993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:22.864355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:26.531812Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:44.117693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:39:46.444317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:04.805541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:15.123225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:25.519975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:35.941289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:46.275830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:40:56.580822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:06.925240Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:17.346781Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:27.697617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:38.154110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:41:41.228827Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T01:41:41.228854Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T01:41:41.228857Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T01:41:41.228861Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T01:41:41.109Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 72 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "88341a0e-4d38-4eca-91d3-61689eaadf4c" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.1.54:48296 10.134.1.54:443 10.132.0.18:36480 - v1-completions-path [2026-11-03T01:41:41.205Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "ecd372d6-64f1-4828-a339-52cef140bd5b" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.54:443 10.132.0.18:36484 - v1-completions-path 2026-11-03T01:41:47.828485Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T01:41:47.828510Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T01:41:47.828513Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T01:41:47.828517Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T01:41:47.716Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 64 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "40b982fb-9ff9-4896-9f58-55f9c0ff07a2" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.54:443 10.132.0.18:50616 - v1-completions-path [2026-11-03T01:41:47.804Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 23 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "66da9c9f-301f-42e9-97d5-3f4229be9a8a" "maas.apps.baebe61d4967c433f29f.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.54:443 10.132.0.18:50628 - v1-completions-path