2026-10-31T05:06:10.904932Z info FLAG: --concurrency="0" 2026-10-31T05:06:10.904951Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T05:06:10.904955Z info FLAG: --help="false" 2026-10-31T05:06:10.904957Z info FLAG: --log_as_json="false" 2026-10-31T05:06:10.904960Z info FLAG: --log_caller="" 2026-10-31T05:06:10.904962Z info FLAG: --log_output_level="default:info" 2026-10-31T05:06:10.904964Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T05:06:10.904971Z info FLAG: --log_target="[stdout]" 2026-10-31T05:06:10.904974Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T05:06:10.904975Z info FLAG: --outlierLogPath="" 2026-10-31T05:06:10.904977Z info FLAG: --profiling="true" 2026-10-31T05:06:10.904979Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T05:06:10.904981Z info FLAG: --proxyLogLevel="warning" 2026-10-31T05:06:10.904983Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T05:06:10.904985Z info FLAG: --stsPort="0" 2026-10-31T05:06:10.904987Z info FLAG: --templateFile="" 2026-10-31T05:06:10.904989Z info FLAG: --tokenManagerPlugin="" 2026-10-31T05:06:10.904992Z info FLAG: --vklog="0" 2026-10-31T05:06:10.904994Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T05:06:10.905135Z info Proxy role ips=[10.133.0.212] type=router id=maas-default-gateway-openshift-default-7d64fcddb7-wxc94.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T05:06:10.905178Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T05:06:10.906265Z info cpu limit detected as 2, setting concurrency 2026-10-31T05:06:10.906453Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T05:06:10.906464Z info JWT policy is third-party-jwt 2026-10-31T05:06:10.906467Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T05:06:10.907805Z info Starting default Istio SDS Server 2026-10-31T05:06:10.907832Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T05:06:10.907850Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T05:06:10.908275Z info Opening status port 15020 2026-10-31T05:06:10.909289Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T05:06:10.909721Z info sds Starting SDS grpc server 2026-10-31T05:06:10.909756Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T05:06:10.910739Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T05:06:10.911499Z info Starting proxy agent 2026-10-31T05:06:10.911534Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T05:06:10.980100Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T05:06:11.100628Z info cache generated new workload certificate resourceName=default latency=190.739572ms ttl=23h59m59.899378033s 2026-10-31T05:06:11.100679Z info cache Root cert has changed, start rotating root cert 2026-10-31T05:06:11.100751Z info cache returned workload trust anchor from cache ttl=23h59m59.899250388s 2026-10-31T05:06:11.142238Z info ads ADS: new connection for node:1 2026-10-31T05:06:11.142301Z info cache returned workload certificate from cache ttl=23h59m59.857701294s 2026-10-31T05:06:11.142420Z info ads ADS: new connection for node:2 2026-10-31T05:06:11.142502Z info cache returned workload trust anchor from cache ttl=23h59m59.857499505s 2026-10-31T05:06:11.222597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:19.122586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:20.059762Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T05:06:20.408345Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T05:06:21.134443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:22.064795Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T05:06:22.450219Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T05:06:22.988412Z info Readiness succeeded in 12.085734061s 2026-10-31T05:06:22.988786Z info Envoy proxy is ready 2026-10-31T05:06:26.739417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:32.204097Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-31T05:06:32.105Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 99 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c0f4738a-90fe-42c6-9f86-68d2e5a14d0d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:43878 10.133.0.212:443 10.132.0.19:45472 - v1-catch-all-path 2026-10-31T05:06:39.858767Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:06:50.368685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:07.283919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:18.907560Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:07:22.472471Z info ads ADS: new connection for node:3 2026-10-31T05:07:22.472770Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:07:22.472920Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:07:25.796296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:10.500939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:08:15.059Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 333 90 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "197cfcbf-569f-4293-86bc-37e475c74e22" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.214:8000" outbound|54321||e2e-prio-pool-36410873-inference-pool-ip-2851bf73.llm.svc.cluster.local 10.133.0.212:51172 10.133.0.212:443 10.132.0.19:37278 - v1-model-routing [2026-10-31T05:08:21.073Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 330 71 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f15ab1e6-a161-412e-852a-7c474bc51d1e" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.214:8000" outbound|54321||e2e-prio-pool-36410873-inference-pool-ip-2851bf73.llm.svc.cluster.local 10.133.0.212:57480 10.133.0.212:443 10.132.0.19:41092 - v1-model-routing 2026-10-31T05:08:35.366884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:35.385715Z info ads ADS: "" 3 terminated 2026-10-31T05:08:41.830887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:08:54.766059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:11:32.006945Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:11:59.706552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:12:36.229479Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:12:51.383590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:00.232663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:13.307272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:13:17.739139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:13:22.264Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "bfbaa7ab-de79-4890-952c-f85996c39285" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.212:443 10.132.0.19:49288 - v1-completions-path 2026-10-31T05:13:36.072329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:17:00.582808Z info ads ADS: new connection for node:4 2026-10-31T05:17:00.586340Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T05:17:00.586392Z info cache read certificate from file resource=file-root:system 2026-10-31T05:17:04.370451Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:17:05.708809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:17:11.338112Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"210","StreamId":"13352323004098149240"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-31T05:17:11.273Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 64 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "aa85af47-2cb8-464f-9214-a9292f9d5253" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.212:443 10.132.0.19:43758 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T05:17:15.872841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T05:17:15.874752Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"214","StreamId":"12539186052379713346"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-31T05:17:15.816Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 58 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "eeb8dc0d-3e4b-416e-aadf-e09ac543fb5c" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.212:443 10.132.0.19:43776 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T05:17:47.063501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:47.063533Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:47.063543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:17:47.063548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:17:47.063722Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-31T05:17:46.859Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1726 204 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "b706ead0-e200-49c0-91bb-9818121bebe1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.212:58504 10.133.0.212:443 10.132.0.19:46826 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:18:03.745110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T05:18:03.745144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T05:18:03.745154Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T05:18:03.745159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T05:18:03.745329Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-31T05:18:03.541Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 204 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "78713f32-407d-42e6-ac84-915b983035ef" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.212:57794 10.133.0.212:443 10.132.0.19:42206 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-31T05:18:35.627434Z info ads ADS: "" 4 terminated with stream closed 2026-10-31T05:18:35.681337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:18:38.696402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:18:48.246649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:18:52.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 76 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "228b8638-4d0c-4fe4-ba23-734572ee0e7d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:52540 10.133.0.212:443 10.132.0.19:46714 - v1-completions-path [2026-10-31T05:18:53.262Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0bfa9986-874c-47bf-8aa6-1db0f7b3789b" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.212:443 10.132.0.19:46728 - v1-completions-path 2026-10-31T05:19:07.110648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:11.818512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:28.303325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:45.221270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:19:53.184Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 67 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "2f8585f0-8050-4af1-bce2-37a7077b4314" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:52540 10.133.0.212:443 10.132.0.19:46212 - v1-completions-path 2026-10-31T05:19:54.625738Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-31T05:19:54.565Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 61 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "25e546b2-ff8a-417b-acf5-cb4707ab019d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:49406 10.133.0.212:443 10.132.0.19:46238 - v1-completions-path 2026-10-31T05:20:16.306539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:27.052993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:33.282739Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:20:44.744Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "b8e33cf4-eba1-9732-8a3e-166bc6a4fd3d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:49406 10.133.0.212:443 10.132.0.19:60040 - v1-completions-path [2026-10-31T05:20:47.691Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 57 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f1a115b7-6f89-4b19-904a-0ea64a7b05ad" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:52540 10.133.0.212:443 10.132.0.19:60060 - v1-completions-path 2026-10-31T05:21:01.918165Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:06.613839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:21:07.084Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 289 99 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6beec542-8eb8-420b-bb7a-44b20887b135" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.58:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:51412 10.133.0.212:443 10.132.0.19:38520 - v1-completions-path 2026-10-31T05:21:19.909891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:26.169687Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:40.822750Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:45.287982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:57.075512Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:12.307368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:18.627129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:38.628357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:44.129063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:55.250381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:19.538892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:30.286496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:49.899161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:23:57.459280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:26:22.898713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:27:30.292892Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T05:27:30.292917Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T05:27:30.292920Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-31T05:27:30.292924Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-31T05:27:30.246Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 46 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "f6978628-add8-4366-b789-f52b77c70c7d" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.212:443 10.132.0.19:49730 - v1-completions-path 2026-10-31T05:27:52.893251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:12.569933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:17.837444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:17.864325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:28:17.864375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:28:17.864396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:28:17.864404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T05:28:17.724Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 140 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "95d1de8b-e7ee-43e8-a3e1-6502c8c953aa" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.212:57870 10.133.0.212:443 10.132.0.19:36776 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-31T05:28:18.069Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 100 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "c8bcd68b-be85-4a87-9c5f-30e1fa4a6df9" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:59302 10.133.0.212:443 10.132.0.19:36778 - v1-completions-path 2026-10-31T05:28:31.531721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:45.285901Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:50.666295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:28:55.761Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "b155833e-4f8c-4010-8607-3ffe3222b2a7" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.212:443 10.132.0.19:40616 - v1-completions-path 2026-10-31T05:29:10.369752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:21.075959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:27.667320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:29:40.927Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 64 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "77ca681c-1283-43bc-9c75-dd35ddd83576" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:52540 10.133.0.212:443 10.132.0.19:53624 - v1-completions-path [2026-10-31T05:29:42.389Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "4d724325-0cb2-4362-916a-010ee6a22193" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.212:443 10.132.0.19:53638 - v1-completions-path 2026-10-31T05:29:43.446092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T05:29:43.446128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-31T05:29:43.446144Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-31T05:29:43.446148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-31T05:29:43.332Z] "DELETE /v1/api-keys/db3e1946-e38e-4e6c-8d95-8ad5995ca579 HTTP/1.1" 200 - via_upstream - "-" 0 365 113 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "ca5fe78e-77b7-4218-af2c-f06fcc3dc095" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.233:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.212:47824 10.133.0.212:443 10.132.0.19:53648 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:29:57.071158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:03.784400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:10.118294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:30:22.515Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "6804577b-11f9-4623-a857-03914f2e6000" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.132.0.57:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:52540 10.133.0.212:443 10.132.0.19:40854 - v1-completions-path 2026-10-31T05:30:42.029001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:52.534770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:59.449608Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:05.839522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:17.929338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:40.787858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:51.571540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:56.790045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:12.806152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:19.221081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:24.551719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:48.269989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:59.385548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:19.258030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:30.269153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:41.213144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:33:52.132861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:02.744657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:13.478207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:24.331402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:35.258716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:34:45.719889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:34:52.747Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 69 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "cf649615-545a-471d-8055-88cb51c06609" "maas.apps.be049019ee31a6cc9291.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.212:34030 10.133.0.212:443 10.132.0.19:41448 - v1-completions-path