2026-10-30T21:47:03.802417Z info FLAG: --concurrency="0" 2026-10-30T21:47:03.802438Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:47:03.802442Z info FLAG: --help="false" 2026-10-30T21:47:03.802444Z info FLAG: --log_as_json="false" 2026-10-30T21:47:03.802447Z info FLAG: --log_caller="" 2026-10-30T21:47:03.802449Z info FLAG: --log_output_level="default:info" 2026-10-30T21:47:03.802451Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:47:03.802456Z info FLAG: --log_target="[stdout]" 2026-10-30T21:47:03.802458Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:47:03.802460Z info FLAG: --outlierLogPath="" 2026-10-30T21:47:03.802462Z info FLAG: --profiling="true" 2026-10-30T21:47:03.802464Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:47:03.802466Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:47:03.802468Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:47:03.802471Z info FLAG: --stsPort="0" 2026-10-30T21:47:03.802472Z info FLAG: --templateFile="" 2026-10-30T21:47:03.802474Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:47:03.802477Z info FLAG: --vklog="0" 2026-10-30T21:47:03.802479Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:47:03.802634Z info Proxy role ips=[10.134.0.129] type=router id=maas-default-gateway-openshift-default-75d7c785f-98fnd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:47:03.802682Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:47:03.803836Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:47:03.804440Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:47:03.804452Z info JWT policy is third-party-jwt 2026-10-30T21:47:03.804455Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:47:03.806153Z info Starting default Istio SDS Server 2026-10-30T21:47:03.806188Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:47:03.806211Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:47:03.806521Z info Opening status port 15020 2026-10-30T21:47:03.807432Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:47:03.809082Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:47:03.809883Z info Starting proxy agent 2026-10-30T21:47:03.809933Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:47:03.818326Z info sds Starting SDS grpc server 2026-10-30T21:47:03.818345Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:47:03.885025Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:47:03.954986Z info cache generated new workload certificate resourceName=default latency=147.748163ms ttl=23h59m59.045019266s 2026-10-30T21:47:03.955024Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:47:03.955061Z info cache returned workload trust anchor from cache ttl=23h59m59.044939886s 2026-10-30T21:47:04.108867Z info ads ADS: new connection for node:1 2026-10-30T21:47:04.108962Z info cache returned workload certificate from cache ttl=23h59m58.891040032s 2026-10-30T21:47:04.108977Z info ads ADS: new connection for node:2 2026-10-30T21:47:04.109052Z info cache returned workload trust anchor from cache ttl=23h59m58.890950978s 2026-10-30T21:47:04.204221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:47:12.297773Z info Readiness succeeded in 8.49769636s 2026-10-30T21:47:12.298195Z info Envoy proxy is ready 2026-10-30T21:48:11.642731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:49:43.795555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:57:22.035405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T21:58:51.325362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:04:10.510404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:05:24.522383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:08:34.666626Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:14:08.882770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:14:43.724996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:14:53.265393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:14:53.265434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:14:53.265451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:14:53.265458Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:14:53.137Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 127 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "6cfc549b-c14c-4816-ab6c-588ae9be9245" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.129:45300 10.134.0.129:443 10.132.0.11:32854 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:15:39.880960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:16:01.404807Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:16:06.199117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:16:36.282933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:16:59.191891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T22:17:11.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 76 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "78c4de24-0ec6-467d-8cdb-a882ce147ec1" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59520 10.134.0.129:443 10.132.0.11:49500 - v1-completions-path [2026-10-30T22:17:13.036Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "763f8119-e342-45fa-90ac-3ade5b73ec0b" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59528 10.134.0.129:443 10.132.0.11:49516 - v1-completions-path [2026-10-30T22:17:14.664Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "47915f91-2d65-4903-9b5b-58580ee9b565" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59528 10.134.0.129:443 10.132.0.11:49534 - v1-completions-path 2026-10-30T22:17:31.961297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:17:52.574542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:17:57.561336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T22:18:10.340Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "653c7987-9f7b-4772-a3d8-03e98cb639cc" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59520 10.134.0.129:443 10.132.0.11:33576 - v1-completions-path 2026-10-30T22:18:12.223269Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:18:12.168Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "32d7d089-c24e-42a2-b8e8-791cb399fac6" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59520 10.134.0.129:443 10.132.0.11:33590 - v1-completions-path [2026-10-30T22:18:13.705Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "ace92bd3-4225-4366-9765-8667cf594251" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.132.0.59:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.129:59520 10.134.0.129:443 10.132.0.11:33606 - v1-completions-path 2026-10-30T22:18:27.537126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:18:32.328843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:18:55.739682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:19:02.353020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:19:38.183223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:00.429959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:13.563792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:19.674997Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:20:54.963886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:21:00.524402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T22:21:10.257Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 34 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "9e173ba6-1e12-46a8-a498-36d9c37e2db5" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.129:443 10.132.0.11:54028 - v1-completions-path 2026-10-30T22:21:18.996623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:21:29.698646Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:01.030637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:11.637938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:29.179149Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:22:40.541104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:25:25.822578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:25:31.931071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:08.168574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:34.948976Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:27:39.769309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:28:04.349036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:31:01.728420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:31:26.664632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:31:57.882697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:32:13.365039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:32:24.981332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:32:37.283744Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:32:42.363184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:32:53.321415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:32:53.321455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:32:53.321470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:32:53.321475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:32:53.008Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "7ad8269c-f0a2-43b6-9c29-8b968e292e0d" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.129:443 10.132.0.11:43594 - v1-completions-path [2026-10-30T22:32:53.268Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 52 - "34.228.250.194,10.132.0.11" "python-requests/2.34.2" "22d0b492-ba3c-4a7b-af80-3ae4d861b0fa" "maas.apps.3049c7e9c141a5bfd526.prod.konflux-ocp-ci.dev" "10.133.0.28:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.129:36560 10.134.0.129:443 10.132.0.11:43598 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:33:06.943586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:37:00.443456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:37:21.459294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:37:42.672485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:37:47.495037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:37:51.636673Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T22:38:02.134231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T22:38:13.843889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7