2026-11-03T01:44:49.703886Z info FLAG: --concurrency="0" 2026-11-03T01:44:49.703906Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T01:44:49.703910Z info FLAG: --help="false" 2026-11-03T01:44:49.703913Z info FLAG: --log_as_json="false" 2026-11-03T01:44:49.703915Z info FLAG: --log_caller="" 2026-11-03T01:44:49.703917Z info FLAG: --log_output_level="default:info" 2026-11-03T01:44:49.703919Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T01:44:49.703923Z info FLAG: --log_target="[stdout]" 2026-11-03T01:44:49.703926Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T01:44:49.703928Z info FLAG: --outlierLogPath="" 2026-11-03T01:44:49.703930Z info FLAG: --profiling="true" 2026-11-03T01:44:49.703932Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T01:44:49.703934Z info FLAG: --proxyLogLevel="warning" 2026-11-03T01:44:49.703936Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T01:44:49.703938Z info FLAG: --stsPort="0" 2026-11-03T01:44:49.703947Z info FLAG: --templateFile="" 2026-11-03T01:44:49.703949Z info FLAG: --tokenManagerPlugin="" 2026-11-03T01:44:49.703955Z info FLAG: --vklog="0" 2026-11-03T01:44:49.703958Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T01:44:49.704099Z info Proxy role ips=[10.133.0.183] type=router id=maas-default-gateway-openshift-default-596dc9545f-ptjsj.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T01:44:49.704142Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T01:44:49.705258Z info cpu limit detected as 2, setting concurrency 2026-11-03T01:44:49.705879Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T01:44:49.705892Z info JWT policy is third-party-jwt 2026-11-03T01:44:49.705896Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T01:44:49.708094Z info Starting default Istio SDS Server 2026-11-03T01:44:49.708121Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T01:44:49.708154Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T01:44:49.708620Z info Opening status port 15020 2026-11-03T01:44:49.709348Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T01:44:49.710001Z info sds Starting SDS grpc server 2026-11-03T01:44:49.710017Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T01:44:49.710671Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T01:44:49.711449Z info Starting proxy agent 2026-11-03T01:44:49.711478Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T01:44:49.732113Z info cache generated new workload certificate resourceName=default latency=21.980932ms ttl=23h59m59.267888579s 2026-11-03T01:44:49.732141Z info cache Root cert has changed, start rotating root cert 2026-11-03T01:44:49.732217Z info cache returned workload trust anchor from cache ttl=23h59m59.267784196s 2026-11-03T01:44:49.776231Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T01:44:49.884293Z info ads ADS: new connection for node:1 2026-11-03T01:44:49.884373Z info cache returned workload certificate from cache ttl=23h59m59.115629521s 2026-11-03T01:44:49.884516Z info ads ADS: new connection for node:2 2026-11-03T01:44:49.884640Z info cache returned workload trust anchor from cache ttl=23h59m59.115361522s 2026-11-03T01:44:49.969027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:44:57.801350Z info Readiness succeeded in 8.099633098s 2026-11-03T01:44:57.801645Z info Envoy proxy is ready 2026-11-03T01:45:14.328902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:45:17.891Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 90 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "50484671-3282-4e7d-87b3-26f7749e1adf" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.134.0.33:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:44626 10.133.0.183:443 10.132.0.9:57342 - v1-chat-completions-path 2026-11-03T01:45:29.402609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:31.641570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:34.153785Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T01:45:34.059Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 94 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "2e06faf5-7c4c-42f6-9698-07669e0b8f1c" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:56594 10.133.0.183:443 10.132.0.9:33224 - v1-catch-all-path 2026-11-03T01:45:37.027483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:39.966234Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T01:45:39.901Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "97b0f600-d2f9-4495-8cd0-53961549cc96" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:56594 10.133.0.183:443 10.132.0.9:45218 - v1-catch-all-path 2026-11-03T01:45:52.058332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:53.627982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:45:58.891556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:46:18.991248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:46:20.808052Z info ads ADS: new connection for node:3 2026-11-03T01:46:20.808572Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:46:20.808605Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-03T01:46:21.618719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:02.814829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:21.314214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:21.670821Z info ads ADS: "" 3 terminated with stream closed 2026-11-03T01:47:23.080380Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:25.796439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:47:45.268055Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T01:47:45.351927Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:49:42.583058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:49:42.583103Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:49:42.583119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T01:49:42.583125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T01:49:42.514Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b372c770-4d90-4326-a1db-519283d9b15d" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.183:55512 10.133.0.183:443 10.132.0.9:43472 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:49:50.702624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:03.929139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:20.027511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:31.805793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:35.176731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:46.177283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:50:48.018973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:03.001135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:48.320016Z info ads ADS: new connection for node:4 2026-11-03T01:51:48.328018Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-03T01:51:48.328077Z info cache read certificate from file resource=file-root:system 2026-11-03T01:51:48.830933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:50.094223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:51:59.232044Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"138","StreamId":"6717131172989658006"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-11-03T01:51:59.164Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a83d7909-cd29-4412-aa3e-e5fce64e4706" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.183:443 10.132.0.9:36888 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-03T01:52:38.557231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:38.557268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:38.557281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:52:38.557287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:52:38.557605Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:52:38.425Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 131 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c0dc3900-8a84-4645-9fb8-e8570783c545" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.183:46348 10.133.0.183:443 10.132.0.9:49440 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:53:10.971640Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T01:53:11.012222Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:53:11.012256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:53:11.012268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:53:11.012273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:53:11.012485Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-03T01:53:10.910Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 102 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ac70443c-4d20-40d8-9e1c-d537a012f727" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.183:46348 10.133.0.183:443 10.132.0.9:46534 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-03T01:53:28.239368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:28.384352Z info ads ADS: "" 4 terminated 2026-11-03T01:53:28.840920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:31.396182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:34.598937Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:46.832987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:53:48.427683Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:02.684848Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T01:54:02.620Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 84 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "3efac7da-57ad-42c2-a383-cb67b3867f48" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:40652 10.133.0.183:443 10.132.0.9:34802 - v1-completions-path 2026-11-03T01:54:03.276751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:04.904480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:07.669368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:15.981376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:54:22.781Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 78 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "ef785088-d3d8-49b6-a288-77147a1bb039" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:48606 10.133.0.183:443 10.132.0.9:50762 - v1-completions-path [2026-11-03T01:54:23.725Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "29e60a24-c90e-4e60-b5bb-f934e52777ac" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:40468 10.133.0.183:443 10.132.0.9:50782 - v1-completions-path 2026-11-03T01:54:40.369179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:50.577140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:54:52.249324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:54:58.723Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1bd99007-401e-4517-8263-42689c3f5ca6" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:48606 10.133.0.183:443 10.132.0.9:57794 - v1-completions-path [2026-11-03T01:54:59.641Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "148cfd60-1e48-4e11-95d6-94c1a5efca43" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:48606 10.133.0.183:443 10.132.0.9:54386 - v1-completions-path 2026-11-03T01:55:11.270252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:12.969741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:27.462749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:55:27.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 93 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "e11bf60a-e33f-4c40-95df-60516423856c" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:54064 10.133.0.183:443 10.132.0.9:50844 - v1-completions-path 2026-11-03T01:55:29.464399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:35.021721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:43.720754Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:55:57.605105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:08.270092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:10.790043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T01:56:11.605Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 1831 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "47f3f102-4994-41c7-b125-c64395cf30e5" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.40:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:40652 10.133.0.183:443 10.132.0.9:49052 - v1-completions-path 2026-11-03T01:56:25.392867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:27.454151Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:31.771195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:56:50.213946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:57:00.507390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:59:25.455112Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:59:25.455186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T01:59:25.455215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T01:59:25.455223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T01:59:25.383Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 72 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "f718add4-98a0-49d3-91f5-41acff94dad3" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.133.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.183:36666 10.133.0.183:443 10.132.0.9:39640 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T01:59:36.936424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T01:59:39.192069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:02.989262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:17.769898Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:19.367882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:34.106289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:43.614420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:01:47.385560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:02.578034Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:13.269597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:16.216232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:02:21.190Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "dc589c92-6701-4085-a873-3e6ac69be778" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:40468 10.133.0.183:443 10.132.0.9:34700 - v1-completions-path [2026-11-03T02:02:21.423Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "114d022f-d818-4091-9278-41009e2a599f" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:48606 10.133.0.183:443 10.132.0.9:34704 - v1-completions-path 2026-11-03T02:02:33.787520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:35.870296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:02:38.920413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:02:43.856Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "32a07a14-7cf0-4c9d-8004-614a82c8afd0" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.183:443 10.132.0.9:54958 - v1-completions-path 2026-11-03T02:03:00.055594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:10.438181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:13.385503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:16.001964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:18.625811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:03:18.625854Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T02:03:18.625875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T02:03:18.625881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T02:03:18.523Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 102 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "df19ce7c-580f-456f-a374-5b660d81e2ec" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.1.122:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.183:52270 10.133.0.183:443 10.132.0.9:40550 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T02:03:20.361581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T02:03:23.334Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 70 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "8615506b-9675-422b-bc31-e4b885ff9fb1" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.183:48606 10.133.0.183:443 10.132.0.9:47242 - v1-completions-path 2026-11-03T02:03:36.890488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:47.074868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:48.693087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:55.889460Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:03:59.133026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:14.788243Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:34.707095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:44.884319Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:04:55.165871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:05.315525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:15.584239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:25.785791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:35.979486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:46.198948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:05:56.436444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:06:06.583715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T02:06:14.189127Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:06:14.189154Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:06:14.189173Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T02:06:14.189179Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T02:06:14.161Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 27 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "67121d70-c3a7-4cee-9ff1-9cb682443e0d" "maas.apps.8703189bab9016eab030.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.183:443 10.132.0.9:38162 - v1-completions-path