2026-10-30T19:17:42.121198Z info FLAG: --concurrency="0" 2026-10-30T19:17:42.121230Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T19:17:42.121244Z info FLAG: --help="false" 2026-10-30T19:17:42.121248Z info FLAG: --log_as_json="false" 2026-10-30T19:17:42.121252Z info FLAG: --log_caller="" 2026-10-30T19:17:42.121256Z info FLAG: --log_output_level="default:info" 2026-10-30T19:17:42.121266Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T19:17:42.121273Z info FLAG: --log_target="[stdout]" 2026-10-30T19:17:42.121277Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T19:17:42.121312Z info FLAG: --outlierLogPath="" 2026-10-30T19:17:42.121316Z info FLAG: --profiling="true" 2026-10-30T19:17:42.121327Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T19:17:42.121330Z info FLAG: --proxyLogLevel="warning" 2026-10-30T19:17:42.121334Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T19:17:42.121337Z info FLAG: --stsPort="0" 2026-10-30T19:17:42.121347Z info FLAG: --templateFile="" 2026-10-30T19:17:42.121350Z info FLAG: --tokenManagerPlugin="" 2026-10-30T19:17:42.121355Z info FLAG: --vklog="0" 2026-10-30T19:17:42.121359Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T19:17:42.121547Z info Proxy role ips=[10.133.0.126] type=router id=maas-default-gateway-openshift-default-75d7c785f-nf2pw.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T19:17:42.121680Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T19:17:42.125312Z info cpu limit detected as 2, setting concurrency 2026-10-30T19:17:42.125713Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T19:17:42.125728Z info JWT policy is third-party-jwt 2026-10-30T19:17:42.125732Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T19:17:42.128000Z info Starting default Istio SDS Server 2026-10-30T19:17:42.128023Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T19:17:42.128047Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T19:17:42.128208Z info Opening status port 15020 2026-10-30T19:17:42.129054Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T19:17:42.130565Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T19:17:42.139828Z info Starting proxy agent 2026-10-30T19:17:42.139892Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T19:17:42.140874Z info sds Starting SDS grpc server 2026-10-30T19:17:42.140895Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T19:17:42.226066Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T19:17:42.245097Z info cache generated new workload certificate resourceName=default latency=109.953345ms ttl=23h59m59.754906272s 2026-10-30T19:17:42.245136Z info cache Root cert has changed, start rotating root cert 2026-10-30T19:17:42.245175Z info cache returned workload trust anchor from cache ttl=23h59m59.75482556s 2026-10-30T19:17:42.470407Z info ads ADS: new connection for node:1 2026-10-30T19:17:42.470490Z info cache returned workload certificate from cache ttl=23h59m59.529512813s 2026-10-30T19:17:42.472481Z info ads ADS: new connection for node:2 2026-10-30T19:17:42.472581Z info cache returned workload trust anchor from cache ttl=23h59m59.527421697s 2026-10-30T19:17:42.611162Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:17:51.373894Z info Readiness succeeded in 9.256735537s 2026-10-30T19:17:51.374229Z info Envoy proxy is ready 2026-10-30T19:21:42.118570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:22:10.530046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:22:57.078187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:23:04.116Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 86 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "56565791-74a4-4d1c-9560-77a741a48799" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.126:43340 10.133.0.126:443 10.132.0.13:57110 - v1-completions-path 2026-10-30T19:23:18.805137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:23:24.684080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:23:50.140822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:23:54.485553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:23:58.912545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:24:08.343317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:24:16.084Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6fb5dab9-8b82-4aa3-9bdd-dcda1720aed7" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.126:443 10.132.0.13:36864 - v1-completions-path [2026-10-30T19:24:17.936Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 68 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9f2f3fd9-5a9d-48a9-8ede-5399e2d69e26" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.126:47670 10.133.0.126:443 10.132.0.13:36868 - v1-completions-path 2026-10-30T19:24:37.819639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:24:48.590164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:24:52.820020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:25:05.126Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 59 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "0dead56c-defd-4319-a8c5-7c20f3fdef3a" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.126:43340 10.133.0.126:443 10.132.0.13:53002 - v1-completions-path [2026-10-30T19:25:05.627Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "5a012b69-f30b-48a6-8d9d-44a44442b81d" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.126:47670 10.133.0.126:443 10.132.0.13:53004 - v1-completions-path 2026-10-30T19:25:20.441563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:25:24.790228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:25:48.568974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:25:54.314060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:26:20.524860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:26:39.470106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:26:52.437856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:26:57.732950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:27:22.919391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:27:27.992259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:27:57.167338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:28:02.164827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:30:19.203855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:30:24.649682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:31:40.854159Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:31:40.854188Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:31:40.854192Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:31:40.854196Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T19:31:40.808Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 45 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "a22c38b7-308a-4a1b-82cc-905843f33008" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.126:443 10.132.0.13:46288 - v1-completions-path 2026-10-30T19:32:01.655121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:32:05.421415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:32:05.421451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:32:05.421468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:32:05.421474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:32:05.310Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 110 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "9fcad01c-8687-4836-9441-e538698cf80d" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.126:47460 10.133.0.126:443 10.132.0.13:45314 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:32:18.833442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:32:23.281355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:32:26.925782Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:32:26.925804Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:32:26.925807Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:32:26.925811Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T19:32:26.891Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 34 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3ac37d92-44a1-4dbd-9521-12f1f06d89b2" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.126:443 10.132.0.13:34374 - v1-completions-path 2026-10-30T19:32:40.293027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:34:19.504908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T19:34:19.604015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:34:19.604059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:34:19.604084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:34:19.604092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T19:34:19.497Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 568 107 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "3ccfdde6-038f-4b92-9a39-4ba6957521a3" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.133.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.126:38218 10.133.0.126:443 10.132.0.13:40764 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:34:29.383234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:34:52.697100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:17.559732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:32.782975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:42.919312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:55.065662Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:59.464279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:25.560751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:36.689028Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:43.764732Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T19:36:43.689Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "7ce00df8-3419-4b95-88f7-96c377e3310b" "maas.apps.65b65f5330ae8ee2f020.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.126:59806 10.133.0.126:443 10.132.0.13:34508 - v1-catch-all-path 2026-10-30T19:36:47.865856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:08.949847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:13.089573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:29.444453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:40.932789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8