2026-11-02T08:10:39.605076Z info FLAG: --concurrency="0" 2026-11-02T08:10:39.605096Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T08:10:39.605101Z info FLAG: --help="false" 2026-11-02T08:10:39.605104Z info FLAG: --log_as_json="false" 2026-11-02T08:10:39.605107Z info FLAG: --log_caller="" 2026-11-02T08:10:39.605109Z info FLAG: --log_output_level="default:info" 2026-11-02T08:10:39.605112Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T08:10:39.605118Z info FLAG: --log_target="[stdout]" 2026-11-02T08:10:39.605122Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T08:10:39.605126Z info FLAG: --outlierLogPath="" 2026-11-02T08:10:39.605130Z info FLAG: --profiling="true" 2026-11-02T08:10:39.605133Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T08:10:39.605136Z info FLAG: --proxyLogLevel="warning" 2026-11-02T08:10:39.605140Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T08:10:39.605143Z info FLAG: --stsPort="0" 2026-11-02T08:10:39.605146Z info FLAG: --templateFile="" 2026-11-02T08:10:39.605149Z info FLAG: --tokenManagerPlugin="" 2026-11-02T08:10:39.605153Z info FLAG: --vklog="0" 2026-11-02T08:10:39.605156Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T08:10:39.605325Z info Proxy role ips=[10.132.1.58] type=router id=maas-default-gateway-openshift-default-7f5667f86c-m4rk6.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T08:10:39.605382Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T08:10:39.606524Z info cpu limit detected as 2, setting concurrency 2026-11-02T08:10:39.606809Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T08:10:39.606823Z info JWT policy is third-party-jwt 2026-11-02T08:10:39.606827Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T08:10:39.608573Z info Starting default Istio SDS Server 2026-11-02T08:10:39.608596Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T08:10:39.608622Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T08:10:39.609000Z info Opening status port 15020 2026-11-02T08:10:39.610061Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T08:10:39.611530Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T08:10:39.612544Z info Starting proxy agent 2026-11-02T08:10:39.612576Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T08:10:39.620599Z info sds Starting SDS grpc server 2026-11-02T08:10:39.620666Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T08:10:39.680173Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T08:10:39.798385Z info cache generated new workload certificate resourceName=default latency=188.422583ms ttl=23h59m59.201620544s 2026-11-02T08:10:39.798440Z info cache Root cert has changed, start rotating root cert 2026-11-02T08:10:39.798484Z info cache returned workload trust anchor from cache ttl=23h59m59.201517198s 2026-11-02T08:10:39.897960Z info ads ADS: new connection for node:1 2026-11-02T08:10:39.903206Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T08:10:39.903254Z info cache read certificate from file resource=file-root:system 2026-11-02T08:10:39.930750Z info ads ADS: new connection for node:2 2026-11-02T08:10:39.930809Z info cache returned workload certificate from cache ttl=23h59m59.069192806s 2026-11-02T08:10:39.931703Z info ads ADS: new connection for node:3 2026-11-02T08:10:39.931767Z info cache returned workload trust anchor from cache ttl=23h59m59.068233833s 2026-11-02T08:10:40.027439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:10:49.281401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:10:52.028022Z info Readiness succeeded in 12.425513109s 2026-11-02T08:10:52.028378Z info Envoy proxy is ready 2026-11-02T08:10:52.072763Z info Readiness succeeded in 12.470260219s 2026-11-02T08:10:52.073641Z info Readiness succeeded in 12.471144597s 2026-11-02T08:11:52.517957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:11.427025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:16.199792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:19.410984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:25.985706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:31.777203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:35.254431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:12:52.004681Z info ads ADS: new connection for node:4 2026-11-02T08:12:52.004876Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T08:12:52.004922Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T08:16:20.613253Z info ads ADS: "" 4 terminated with stream closed 2026-11-02T08:16:41.272922Z info ads ADS: "" 1 terminated 2026-11-02T08:24:11.119304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:25:41.121442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:28:10.410270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:30:01.634066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:14.946439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:39:37.699122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:10.916258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:26.685741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:29.175077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:35.661446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:43.246562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:40:53.574220Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T08:40:53.699173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:41:07.410080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:41:18.400473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:41:21.033599Z info ads ADS: new connection for node:5 2026-11-02T08:41:21.033771Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T08:41:23.787228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:42:02.822626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:42:07.964Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 349 102 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "c2635c46-d627-4eee-a893-29b84b1446b8" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.1.70:8000" outbound|54321||e2e-prio-pool-5b37c7ac-inference-pool-ip-4202debe.llm.svc.cluster.local 10.132.1.58:60500 10.132.1.58:443 10.132.0.12:39016 - v1-model-routing 2026-11-02T08:42:21.814497Z info ads ADS: "" 5 terminated with stream closed 2026-11-02T08:42:21.860847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:42:25.302660Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:42:33.542976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:04.149853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:19.427474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:35.495670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:47.374635Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:45:51.051829Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:01.583053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:46:06.292488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:46:09.124Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 84 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "a07be16e-00c5-4648-8750-48c518b92667" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:44150 10.132.1.58:443 10.132.0.12:44904 - v1-completions-path 2026-11-02T08:46:21.569851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:47:06.287Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 89 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3615964a-d3c4-4f25-93df-0e8aa94149c5" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:33598 10.132.1.58:443 10.132.0.12:40730 - v1-completions-path 2026-11-02T08:47:07.655152Z info ads ADS: new connection for node:6 2026-11-02T08:47:07.659198Z info cache read certificate from file resource=file-root:system 2026-11-02T08:47:08.981130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:47:10.563704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:47:17.655277Z warning envoy ext_proc external/envoy/source/extensions/filters/http/ext_proc/ext_proc.cc:1688 [Tags: "ConnectionId":"614","StreamId":"2872062868637416220"] Received gRPC error on stream: 14, message upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}} thread=26 [2026-11-02T08:47:17.596Z] "POST /models-as-a-service/e2e-rotation-external-model/anything/v1/chat/completions HTTP/1.1" 500 - ext_proc_error_gRPC_error_14{upstream_connect_error_or_disconnect/reset_before_headers._reset_reason:_remote_connection_failure,_transport_failure_reason:_delayed_connect_error:_Connection_refused{upstream_reset_before_response_started{remote_connection_failure|delayed_connect_error:_Connection_refused}}} - "-" 92 0 58 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f931c8b3-c174-4175-b9da-b095248ba9ac" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-rotation-external-model.models-as-a-service.svc.cluster.local - 10.132.1.58:443 10.132.0.12:45618 - models-as-a-service.external-model-e2e-rotation-external-model.2 2026-11-02T08:47:24.016348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:47:24.016383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:47:24.016394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:47:24.016398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:47:24.016552Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T08:47:23.908Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 108 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3faf1b94-f73b-421a-bf29-58be9ffd3963" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.58:53238 10.132.1.58:443 10.132.0.12:45500 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T08:48:48.483973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:48:48.593494Z info ads ADS: "" 6 terminated with stream closed 2026-11-02T08:48:50.030650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:48:56.784455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:48:59.659Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 70 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "b12647e3-4c09-4dbe-b200-cf5c8d13d333" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:44150 10.132.1.58:443 10.132.0.12:57784 - v1-completions-path 2026-11-02T08:49:12.571083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:49:17.240174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:49:20.256Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 63 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "0c1c867f-093e-4190-bcff-1c0393dd1087" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.58:443 10.132.0.12:53712 - v1-completions-path 2026-11-02T08:49:32.572463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:49:48.335306Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:49:53.164048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:49:53.164087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:49:53.164101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:49:53.164106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:49:53.164113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T08:49:53.763395Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-02T08:49:53.085Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 78 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "ce1e1134-9157-4878-baad-f8b9e853ef95" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.58:47946 10.132.1.58:443 10.132.0.12:57556 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:49:53.708Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 63 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "0dc71db3-8751-44f0-9388-5bb3cd34d2af" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:42332 10.132.1.58:443 10.132.0.12:57566 - v1-completions-path [2026-11-02T08:49:55.380Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "5e8227fe-dda6-4eaf-b744-2908e77bc3ac" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:44150 10.132.1.58:443 10.132.0.12:57574 - v1-completions-path 2026-11-02T08:50:11.419218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:50:21.698385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:50:26.415313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:50:43.328613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:50:45.737574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:51:10.421620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:51:12.111Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 72 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "ce0a3b7a-2645-415d-b205-17494329db13" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:33598 10.132.1.58:443 10.132.0.12:37566 - v1-completions-path 2026-11-02T08:51:15.015581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:51:21.137457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:51:28.161695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:51:33.608300Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:51:39.714Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 69 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "60153028-5396-4c8a-ad19-f04eeecd39ab" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:33598 10.132.1.58:443 10.132.0.12:44436 - v1-completions-path 2026-11-02T08:51:51.869684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:51:54.919013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:11.029468Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:14.119265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:22.812296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:40.631337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:52:51.079190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:07.624362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:53:11.078500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:55:31.931726Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:55:35.354745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:00.740934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:16.208708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:18.682030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:26.117148Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:42.978552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:57:45.962602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T08:57:45.962642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T08:57:45.962659Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T08:57:45.962665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T08:57:46.093920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:57:45.881Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 80 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "21a7d4b7-e3da-4935-83cf-e058f0325402" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.1.90:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.58:33190 10.132.1.58:443 10.132.0.12:37412 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T08:58:01.861627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:12.455684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:17.266232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:58:22.110Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 68 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f7cbd1c2-787f-4d3d-8cba-98fadd894da2" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:42332 10.132.1.58:443 10.132.0.12:35010 - v1-completions-path 2026-11-02T08:58:34.410398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:39.178786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:42.843562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:58:48.316295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:58:48.316347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T08:58:48.316371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T08:58:48.316378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T08:58:48.233Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 68 311 82 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "29d2fdb1-7eaf-4252-b8be-804405ff269f" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.1.90:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.58:34938 10.132.1.58:443 10.132.0.12:38920 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T08:58:51.320Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "22fdbfdd-c91e-41c3-beb9-d36f6a70be50" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:42332 10.132.1.58:443 10.132.0.12:43958 - v1-completions-path [2026-11-02T08:58:51.869Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "ba76bc9b-6eda-4a6b-87ed-13d300c75973" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:44150 10.132.1.58:443 10.132.0.12:43970 - v1-completions-path 2026-11-02T08:59:05.245602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:08.619775Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-11-02T08:59:15.602420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:30.228492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:33.433913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T08:59:38.626231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T08:59:43.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 62 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "708a44c6-09b9-4793-98e8-6bf87890af03" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.133.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:44150 10.132.1.58:443 10.132.0.12:37904 - v1-completions-path 2026-11-02T08:59:56.931779Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:00:07.288963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:00:09.832119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:00:22.188845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:00:25.883619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:00:44.334884Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:04.346141Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:14.699175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:25.149003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:35.664701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:46.132402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:01:56.422620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:02:06.837715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:02:17.177133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:02:27.491331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T09:02:37.793909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T09:02:46.870Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 78 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "903e1a79-be86-43b1-b410-2985570bc933" "maas.apps.42d731be0d545102950e.prod.konflux-ocp-ci.dev" "10.132.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.58:43168 10.132.1.58:443 10.132.0.12:33772 - v1-completions-path