2026-10-30T13:53:48.713312Z info FLAG: --concurrency="0" 2026-10-30T13:53:48.713666Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T13:53:48.713704Z info FLAG: --help="false" 2026-10-30T13:53:48.713729Z info FLAG: --log_as_json="false" 2026-10-30T13:53:48.713752Z info FLAG: --log_caller="" 2026-10-30T13:53:48.713775Z info FLAG: --log_output_level="default:info" 2026-10-30T13:53:48.713796Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T13:53:48.713823Z info FLAG: --log_target="[stdout]" 2026-10-30T13:53:48.713846Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T13:53:48.713889Z info FLAG: --outlierLogPath="" 2026-10-30T13:53:48.713922Z info FLAG: --profiling="true" 2026-10-30T13:53:48.713944Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T13:53:48.713965Z info FLAG: --proxyLogLevel="warning" 2026-10-30T13:53:48.713987Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T13:53:48.714009Z info FLAG: --stsPort="0" 2026-10-30T13:53:48.714031Z info FLAG: --templateFile="" 2026-10-30T13:53:48.714053Z info FLAG: --tokenManagerPlugin="" 2026-10-30T13:53:48.714085Z info FLAG: --vklog="0" 2026-10-30T13:53:48.714109Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T13:53:48.714366Z info Proxy role ips=[10.132.0.34] type=router id=maas-default-gateway-openshift-default-fd4b99879-kgqhx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T13:53:48.714474Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T13:53:48.716316Z info cpu limit detected as 2, setting concurrency 2026-10-30T13:53:48.716679Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T13:53:48.716745Z info JWT policy is third-party-jwt 2026-10-30T13:53:48.716772Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T13:53:48.718659Z info Starting default Istio SDS Server 2026-10-30T13:53:48.719231Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T13:53:48.719333Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T13:53:48.719153Z info Opening status port 15020 2026-10-30T13:53:48.720899Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T13:53:48.728937Z info sds Starting SDS grpc server 2026-10-30T13:53:48.728971Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T13:53:48.730699Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T13:53:48.732028Z info Starting proxy agent 2026-10-30T13:53:48.732112Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T13:53:48.806170Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T13:53:48.929066Z info ads ADS: new connection for node:1 2026-10-30T13:53:48.929571Z info ads ADS: new connection for node:2 2026-10-30T13:53:49.003080Z info cache generated new workload certificate resourceName=default latency=281.289027ms ttl=23h59m59.996924324s 2026-10-30T13:53:49.003122Z info cache Root cert has changed, start rotating root cert 2026-10-30T13:53:49.003162Z info cache returned workload trust anchor from cache ttl=23h59m59.996839423s 2026-10-30T13:53:49.003189Z info cache returned workload certificate from cache ttl=23h59m59.996811913s 2026-10-30T13:53:49.003297Z info cache returned workload trust anchor from cache ttl=23h59m59.996709624s 2026-10-30T13:53:49.003571Z info cache returned workload trust anchor from cache ttl=23h59m59.996430033s 2026-10-30T13:53:49.083810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:53:56.962203Z info Readiness succeeded in 8.254466963s 2026-10-30T13:53:56.962514Z info Envoy proxy is ready 2026-10-30T13:54:04.191292Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:06.655919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:21.730693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:32.558264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:54:35.191544Z info ads ADS: new connection for node:3 2026-10-30T13:54:35.191747Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:54:35.191783Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T13:54:36.393797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:16.808741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:55:20.503Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 328 99 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "cc9bee6d-8e77-4521-be21-94f29e0821fa" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.1.40:8000" outbound|54321||e2e-prio-pool-47dd2769-inference-pool-ip-de055579.llm.svc.cluster.local 10.132.0.34:33548 10.132.0.34:443 10.132.0.12:52080 - v1-model-routing 2026-10-30T13:55:35.793114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:35.942252Z info ads ADS: "" 3 terminated 2026-10-30T13:55:38.970466Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:55:46.799376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:22.938285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:39.191740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:57:54.222790Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:08.271787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:12.138587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:23.822839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:27.827172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:58:46.094379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T13:59:03.333Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 75 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "a8b0bccb-b394-478b-88de-49ffcae75aff" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:47350 10.132.0.34:443 10.132.0.12:50460 - v1-completions-path 2026-10-30T13:59:32.540638Z info ads ADS: new connection for node:4 2026-10-30T13:59:32.550285Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T13:59:32.550339Z info cache read certificate from file resource=file-root:system 2026-10-30T13:59:33.572342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:59:35.380209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T13:59:42.571159Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"111","StreamId":"16457939148478913669"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-30T13:59:42.508Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "274232c6-1680-47ee-aad9-7452aefa8079" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.0.34:443 10.132.0.12:46556 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-30T13:59:55.212541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:55.212579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:55.212590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:55.212595Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:59:55.212774Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T13:59:55.101Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1714 111 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f6b9786c-3194-4a1f-bed7-28826c7c4af1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54430 10.132.0.34:443 10.132.0.12:44524 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T13:59:57.330267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:57.330302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:57.330312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T13:59:57.330317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T13:59:57.330469Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T13:59:57.235Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 95 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d63242ae-bfa2-42eb-a8aa-7f488935818e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54430 10.132.0.34:443 10.132.0.12:44538 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:00:33.513899Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:33.513930Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T14:00:33.513944Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:33.513958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:00:33.513962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:00:33.514142Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:00:33.415Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 98 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "d2135336-8c52-47a8-a246-4768ce3b471d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54430 10.132.0.34:443 10.132.0.12:48180 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:00:39.902947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:39.902985Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:39.902995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:00:39.903000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T14:00:39.903186Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T14:00:39.796Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 106 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "e2515c4c-5350-47b2-8eb1-c534ca52f140" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54110 10.132.0.34:443 10.132.0.12:52498 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:01:01.145902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:01:01.145940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:01:01.145952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:01:01.145956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:01:01.146146Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T14:01:01.043Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 102 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "ec0d6c6f-8fc0-42c4-b434-1aa4423eb6b9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54430 10.132.0.34:443 10.132.0.12:60058 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:01:03.229638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T14:01:03.266989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:01:03.267034Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:01:03.267050Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:01:03.267057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T14:01:03.267286Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T14:01:03.174Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 93 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2849345c-6f22-4cda-b677-d849c70966ab" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.34:54110 10.132.0.34:443 10.132.0.12:60066 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T14:01:17.712760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:01:17.712800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:01:17.712818Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T14:01:17.712822Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T14:01:17.627Z] "DELETE /v1/api-keys/ab1caaf1-e1bb-40bb-94b0-0eb01b39f7bd HTTP/1.1" 200 - via_upstream - "-" 0 359 85 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "589efc17-e6b9-48a7-afcc-d0721d11c276" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:50640 10.132.0.34:443 10.132.0.12:44840 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:01:29.322908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:29.415705Z info ads ADS: "" 4 terminated 2026-10-30T14:01:29.690803Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T14:01:29.690830Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T14:01:29.690833Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T14:01:29.690836Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T14:01:29.653Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 37 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8ffd5491-3ccb-48d1-ba20-b4ea0e96f59d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.34:443 10.132.0.12:53068 - v1-completions-path 2026-10-30T14:01:30.774976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:37.682751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:54.640704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:01:59.145623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:17.546968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:02:33.474763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:02:44.206Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "49e034dc-336c-4ffc-a2a7-c5748e9fccf8" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51312 10.132.0.34:443 10.132.0.12:43734 - v1-completions-path [2026-10-30T14:02:47.047Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f9c61fd1-1be0-4276-840a-11fa8d96107f" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:43750 - v1-completions-path 2026-10-30T14:03:02.476400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:12.815211Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:17.357288Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:03:24.977Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "2404c77c-7b5a-4bbd-ad09-14eab00c32cf" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:42766 - v1-completions-path 2026-10-30T14:03:37.662601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:40.075784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:03:46.976386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:03:46.976425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:03:46.976440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:03:46.976445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T14:03:46.897Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 79 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "8c07144e-36dd-4f97-bdb7-f5f3d038d053" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:45060 10.132.0.34:443 10.132.0.12:34100 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:03:59.073303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:03.616962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:21.985661Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:24.274517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:41.945887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:53.568105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:04:56.675624Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:17.092911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:19.402131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:32.963907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:05:50.720302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:01.021313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:20.566948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:06:24.058486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:08.050535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:08:11.655989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:09:46.243908Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:01.730918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:04.127588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:22.829177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:34.504816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:37.815575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:10:53.301751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:03.937221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:08.759932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:12.351627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:11:12.351677Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:11:12.351698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T14:11:12.351705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T14:11:12.272Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 78 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "63369ee1-b8c2-49e2-996a-36bc8b563c0d" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.83:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:33846 10.132.0.34:443 10.132.0.12:45730 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:11:25.916439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:30.345057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:11:33.486955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:11:40.159Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 63 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "de009349-8e16-4850-96ad-de9a9d89ba14" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:52246 - v1-completions-path [2026-10-30T14:11:42.804Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "19b0ff84-a3a6-4e2a-b550-a0d4e80719c3" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:52260 - v1-completions-path [2026-10-30T14:11:43.889Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b2443729-a01f-4a36-84ba-2d359eaaf3eb" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:52290 - v1-completions-path 2026-10-30T14:11:56.540108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:06.786868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:11.361177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:15.240062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:18.216215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:12:18.216254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:12:18.216270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T14:12:18.216276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T14:12:18.130Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 86 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "3644cf87-ba23-4f69-be03-88762bd8e15b" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.133.1.55:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.34:36724 10.132.0.34:443 10.132.0.12:35264 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T14:12:20.394654Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T14:12:35.659Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "241c0379-1ace-4232-92ff-c7a723901145" "maas.apps.8221dcd364f53fb28015.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.34:51322 10.132.0.34:443 10.132.0.12:50720 - v1-completions-path 2026-10-30T14:12:48.654686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:12:58.893959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:01.121516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:13.671977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:18.661506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:35.440953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:13:55.212964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:05.605423Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:15.935334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:26.292021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:36.640245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:47.040944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:14:57.318993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:07.690233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:17.994250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T14:15:28.350977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8