2026-10-30T01:26:58.574740Z info FLAG: --concurrency="0" 2026-10-30T01:26:58.574757Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T01:26:58.574761Z info FLAG: --help="false" 2026-10-30T01:26:58.574764Z info FLAG: --log_as_json="false" 2026-10-30T01:26:58.574766Z info FLAG: --log_caller="" 2026-10-30T01:26:58.574768Z info FLAG: --log_output_level="default:info" 2026-10-30T01:26:58.574770Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T01:26:58.574775Z info FLAG: --log_target="[stdout]" 2026-10-30T01:26:58.574777Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T01:26:58.574779Z info FLAG: --outlierLogPath="" 2026-10-30T01:26:58.574781Z info FLAG: --profiling="true" 2026-10-30T01:26:58.574783Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T01:26:58.574785Z info FLAG: --proxyLogLevel="warning" 2026-10-30T01:26:58.574787Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T01:26:58.574789Z info FLAG: --stsPort="0" 2026-10-30T01:26:58.574791Z info FLAG: --templateFile="" 2026-10-30T01:26:58.574793Z info FLAG: --tokenManagerPlugin="" 2026-10-30T01:26:58.574796Z info FLAG: --vklog="0" 2026-10-30T01:26:58.574798Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T01:26:58.574947Z info Proxy role ips=[10.134.1.79] type=router id=maas-default-gateway-openshift-default-7bdc57c4cf-zpcs2.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T01:26:58.575003Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T01:26:58.576032Z info cpu limit detected as 2, setting concurrency 2026-10-30T01:26:58.576862Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T01:26:58.576882Z info JWT policy is third-party-jwt 2026-10-30T01:26:58.576891Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T01:26:58.578091Z info Starting default Istio SDS Server 2026-10-30T01:26:58.578110Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T01:26:58.578127Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T01:26:58.578187Z info Opening status port 15020 2026-10-30T01:26:58.579403Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T01:26:58.579748Z info sds Starting SDS grpc server 2026-10-30T01:26:58.579769Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T01:26:58.580635Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T01:26:58.581412Z info Starting proxy agent 2026-10-30T01:26:58.581442Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T01:26:58.658857Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T01:26:58.717521Z info cache generated new workload certificate resourceName=default latency=137.69482ms ttl=23h59m59.282483068s 2026-10-30T01:26:58.717552Z info cache Root cert has changed, start rotating root cert 2026-10-30T01:26:58.717581Z info cache returned workload trust anchor from cache ttl=23h59m59.28241994s 2026-10-30T01:26:58.765808Z info ads ADS: new connection for node:1 2026-10-30T01:26:58.765863Z info cache returned workload certificate from cache ttl=23h59m59.234138032s 2026-10-30T01:26:58.766039Z info ads ADS: new connection for node:2 2026-10-30T01:26:58.766112Z info cache returned workload trust anchor from cache ttl=23h59m59.233889831s 2026-10-30T01:26:58.846768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:27:06.812572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:27:07.764853Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:27:08.126481Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T01:27:08.789934Z info Readiness succeeded in 10.217295921s 2026-10-30T01:27:08.790297Z info Envoy proxy is ready 2026-10-30T01:27:14.903442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:27:14.903477Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:27:14.903488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T01:27:14.903493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T01:27:14.817Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 86 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e710092d-64e4-4d75-9f82-43f99bf2e523" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "10.132.0.52:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.79:41830 10.134.1.79:443 10.132.0.19:41176 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T01:27:44.434266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T01:27:48.707Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "83537eda-83b7-4742-a762-b22b2234fb5d" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.79:56880 10.134.1.79:443 10.132.0.19:48494 - v1-completions-path [2026-10-30T01:27:48.906Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d2080fdc-2d0d-41f3-9f2e-777b89f52c54" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.79:56880 10.134.1.79:443 10.132.0.19:48508 - v1-completions-path [2026-10-30T01:27:49.590Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7157774d-0186-4768-8a81-04decd66891d" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.79:443 10.132.0.19:57468 - v1-completions-path 2026-10-30T01:28:01.612818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:28:05.981180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:28:24.279889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:28:38.178873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T01:28:45.765Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5f977b82-f243-4947-96cf-7fd4254b7402" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.79:42814 10.134.1.79:443 10.132.0.19:48374 - v1-completions-path [2026-10-30T01:28:45.856Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "08d98d08-1f07-4540-a21e-f59d7b0acaba" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.79:42814 10.134.1.79:443 10.132.0.19:48386 - v1-completions-path 2026-10-30T01:29:01.817907Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:12.175622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:16.504693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:33.409082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:35.730613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:54.820572Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:29:59.014970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:30:15.599881Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:30:31.627562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:30:42.445263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:30:45.364457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:31:04.503786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:31:07.315491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T01:31:12.692Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 31 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2867d5e5-87c0-4a39-9a9e-544999ffc698" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.79:443 10.132.0.19:40790 - v1-completions-path 2026-10-30T01:31:28.235578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:31:31.008505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:33:07.684843Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:33:10.976902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:34:40.861981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:34:56.023418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:34:58.234021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:35:11.024220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:36:29.543469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:36:46.153048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:01.018328Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:15.103831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:19.535856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:31.290977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:36.424865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:37:41.769224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T01:37:41.763Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 56 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3217c4f0-260c-4a3c-838a-0a3ffcbe4b83" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.79:443 10.132.0.19:59122 - v1-completions-path 2026-10-30T01:37:53.751342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:00.971900Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T01:38:00.971922Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T01:38:00.971925Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T01:38:00.971930Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T01:38:00.903Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 68 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8bddea7e-dfb7-47e5-a738-d2e935b9187a" "maas.apps.bea7b45522541d1e61da.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.79:443 10.132.0.19:49390 - v1-catch-all-path 2026-10-30T01:38:03.234366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:09.051483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:24.914960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:27.128777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:42.105322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T01:38:52.913001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9