2026-10-31T05:19:20.708371Z info FLAG: --concurrency="0" 2026-10-31T05:19:20.708392Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T05:19:20.708397Z info FLAG: --help="false" 2026-10-31T05:19:20.708401Z info FLAG: --log_as_json="false" 2026-10-31T05:19:20.708404Z info FLAG: --log_caller="" 2026-10-31T05:19:20.708407Z info FLAG: --log_output_level="default:info" 2026-10-31T05:19:20.708409Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T05:19:20.708415Z info FLAG: --log_target="[stdout]" 2026-10-31T05:19:20.708419Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T05:19:20.708422Z info FLAG: --outlierLogPath="" 2026-10-31T05:19:20.708425Z info FLAG: --profiling="true" 2026-10-31T05:19:20.708428Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T05:19:20.708432Z info FLAG: --proxyLogLevel="warning" 2026-10-31T05:19:20.708435Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T05:19:20.708439Z info FLAG: --stsPort="0" 2026-10-31T05:19:20.708441Z info FLAG: --templateFile="" 2026-10-31T05:19:20.708444Z info FLAG: --tokenManagerPlugin="" 2026-10-31T05:19:20.708448Z info FLAG: --vklog="0" 2026-10-31T05:19:20.708451Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T05:19:20.708638Z info Proxy role ips=[10.133.0.244] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-ptb2g.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T05:19:20.708701Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T05:19:20.709754Z info cpu limit detected as 2, setting concurrency 2026-10-31T05:19:20.709979Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T05:19:20.709993Z info JWT policy is third-party-jwt 2026-10-31T05:19:20.709998Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T05:19:20.712005Z info Starting default Istio SDS Server 2026-10-31T05:19:20.712029Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T05:19:20.712054Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T05:19:20.712292Z info Opening status port 15020 2026-10-31T05:19:20.713146Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T05:19:20.713610Z info sds Starting SDS grpc server 2026-10-31T05:19:20.713626Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T05:19:20.714728Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T05:19:20.715544Z info Starting proxy agent 2026-10-31T05:19:20.715576Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T05:19:20.761235Z info cache generated new workload certificate resourceName=default latency=47.483429ms ttl=23h59m59.238768426s 2026-10-31T05:19:20.761272Z info cache Root cert has changed, start rotating root cert 2026-10-31T05:19:20.761309Z info cache returned workload trust anchor from cache ttl=23h59m59.238691989s 2026-10-31T05:19:20.780614Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T05:19:20.893146Z info ads ADS: new connection for node:1 2026-10-31T05:19:20.893222Z info cache returned workload certificate from cache ttl=23h59m59.106780335s 2026-10-31T05:19:20.893762Z info ads ADS: new connection for node:2 2026-10-31T05:19:20.893853Z info cache returned workload trust anchor from cache ttl=23h59m59.106149182s 2026-10-31T05:19:20.974960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:19:28.884256Z info Readiness succeeded in 8.178283411s 2026-10-31T05:19:28.884610Z info Envoy proxy is ready 2026-10-31T05:19:50.215477Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:06.491196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:09.986558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:16.133416Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:24.200196Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:33.665494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:48.851915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:20:59.828269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:02.207706Z info ads ADS: new connection for node:3 2026-10-31T05:21:02.207882Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:21:02.207907Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-31T05:21:04.001132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:21:44.320125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:04.121305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:05.157828Z info ads ADS: "" 3 terminated with stream closed 2026-10-31T05:22:07.525855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:22:09.842Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 83 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1ca2211c-9747-44aa-b12c-581bfffa2bec" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:57494 10.133.0.244:443 10.132.0.18:33674 - v1-completions-path 2026-10-31T05:22:11.499508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:22:16.302369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:24:29.675206Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:24:29.675248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:24:29.675264Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:24:29.675271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T05:24:29.608Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 66 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "386fd51e-b25e-4ee7-855d-9fa625e9e4ac" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.244:56498 10.133.0.244:443 10.132.0.18:48790 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:24:34.989931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:24:50.627619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:07.289340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:19.331888Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:24.653797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:28.462370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:38.782433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:25:43.422290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:25:46.536Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 80 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1ba3b4a0-e6d8-490d-bfad-ed9db4679cc1" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:34978 10.133.0.244:443 10.132.0.18:34070 - v1-completions-path 2026-10-31T05:25:58.880242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:26:46.019386Z info ads ADS: new connection for node:4 2026-10-31T05:26:46.026069Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-31T05:26:46.026117Z info cache read certificate from file resource=file-root:system 2026-10-31T05:26:47.061558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:26:48.742581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:26:55.391150Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"140","StreamId":"2399795726379600200"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-31T05:26:55.331Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 60 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "72b4d2c4-d0d6-4e43-b46a-9f5ab22c949e" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.244:443 10.132.0.18:50380 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T05:26:57.525042Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"144","StreamId":"1109770453048338390"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=24 [2026-10-31T05:26:57.465Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 59 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "8d4d808b-a257-44be-bdef-919c53147e8f" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.244:443 10.132.0.18:50412 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T05:26:59.609902Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"147","StreamId":"17030313116651973131"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=25 [2026-10-31T05:26:59.547Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 62 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "4b1c2080-27ab-45b2-851f-f2d45fd9e6c7" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.133.0.244:443 10.132.0.18:50428 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-10-31T05:28:16.044050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:16.138400Z info ads ADS: "" 4 terminated 2026-10-31T05:28:17.723902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:24.992301Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:41.349038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:28:46.142388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:01.657574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:17.414227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:29:23.646Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 63 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1c18a6f8-00cd-44d4-b70f-be1c957ec76e" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:59146 10.133.0.244:443 10.132.0.18:45534 - v1-completions-path 2026-10-31T05:29:24.115559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-31T05:29:24.060Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1612c455-265d-45ac-b2bc-7e60fab83ec1" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:34978 10.133.0.244:443 10.132.0.18:45546 - v1-completions-path 2026-10-31T05:29:41.046753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:51.543259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:29:55.470146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:13.299443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:15.730429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:23.613227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:35.340603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:40.181816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:48.785163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:30:54.538446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:12.378027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:15.729194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:32.775433Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:32.775469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:32.775485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:31:32.775490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:31:32.549Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 32 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "82ed260f-c657-48c8-86d2-6645a4dfd816" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.244:443 10.132.0.18:57030 - v1-completions-path [2026-10-31T05:31:32.701Z] "DELETE /v1/api-keys/c3277d16-be29-42a8-a824-9b61c3ad0923 HTTP/1.1" 200 - via_upstream - "-" 0 375 73 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "53b0404c-bd97-414c-87a1-b699002ab85a" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.244:45866 10.133.0.244:443 10.132.0.18:57036 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:31:39.547783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:31:45.064253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T05:31:45.070490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:45.070524Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T05:31:45.070540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T05:31:45.070545Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T05:31:44.988Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 310 81 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "e546a542-71bc-4bc5-9ae9-0aa779cac420" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.244:45866 10.133.0.244:443 10.132.0.18:38104 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:31:57.506203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:07.858273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:32:11.831476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:32:11.831513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:32:11.831531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:32:11.831536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-31T05:32:11.755Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 76 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "782d4b1e-7a18-4d94-ac7d-7a14f7137fba" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.244:51760 10.133.0.244:443 10.132.0.18:39308 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:36:14.618040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:36:30.354634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:36:32.626664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:36:39.934228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:36:59.532613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:02.757685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:37:02.757725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:37:02.757741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-31T05:37:02.757746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-31T05:37:02.845079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:37:02.667Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 315 89 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "09af8976-2fdb-46dc-a1cf-3a3330fef840" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.133.0.255:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.244:58456 10.133.0.244:443 10.132.0.18:41400 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T05:37:18.681923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:29.027883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:34.010128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:50.982373Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:55.377400Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:37:59.269118Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:38:05.601Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 73 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "4ad0e874-00fe-4993-b26d-7e902eccd19f" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:34978 10.133.0.244:443 10.132.0.18:58250 - v1-completions-path 2026-10-31T05:38:21.888199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:38:32.364098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:38:36.935589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:38:40.856631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:38:45.905592Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T05:38:51.031Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "93027a7f-ccb4-4c77-ae8b-0188fcfe681d" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:59146 10.133.0.244:443 10.132.0.18:46032 - v1-completions-path [2026-10-31T05:38:51.220Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "eb8996fe-94e2-4bcc-8d5c-213569449d7a" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:34978 10.133.0.244:443 10.132.0.18:46048 - v1-completions-path [2026-10-31T05:38:51.594Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "fec3694c-02a0-4843-a9a1-5349798fb08c" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.48:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:34978 10.133.0.244:443 10.132.0.18:46062 - v1-completions-path 2026-10-31T05:39:04.342089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:14.578691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:16.852968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:26.576064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:30.424470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:47.796497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:39:50.056542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:40:08.556414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:40:18.950237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:40:29.309389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:40:39.612894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:40:49.940644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:00.354826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:10.713059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:21.131973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:31.443646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:41.680994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T05:41:46.801852Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T05:41:46.801881Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T05:41:46.801884Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T05:41:46.801889Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T05:41:46.776Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 25 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "bc0db612-abfd-4b72-bb62-7b65e50c891b" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.244:443 10.132.0.18:36094 - v1-completions-path [2026-10-31T05:41:48.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 86 - "52.71.36.72,10.132.0.18" "python-requests/2.34.2" "1609d9fb-64df-42b7-9f61-b38d420c3c61" "maas.apps.395278aa9995a3d74ddf.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.244:37034 10.133.0.244:443 10.132.0.18:36100 - v1-completions-path