2026-10-30T23:07:45.118004Z info FLAG: --concurrency="0" 2026-10-30T23:07:45.118089Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T23:07:45.118095Z info FLAG: --help="false" 2026-10-30T23:07:45.118098Z info FLAG: --log_as_json="false" 2026-10-30T23:07:45.118100Z info FLAG: --log_caller="" 2026-10-30T23:07:45.118102Z info FLAG: --log_output_level="default:info" 2026-10-30T23:07:45.118104Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T23:07:45.118109Z info FLAG: --log_target="[stdout]" 2026-10-30T23:07:45.118111Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T23:07:45.118114Z info FLAG: --outlierLogPath="" 2026-10-30T23:07:45.118116Z info FLAG: --profiling="true" 2026-10-30T23:07:45.118118Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T23:07:45.118120Z info FLAG: --proxyLogLevel="warning" 2026-10-30T23:07:45.118122Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T23:07:45.118124Z info FLAG: --stsPort="0" 2026-10-30T23:07:45.118126Z info FLAG: --templateFile="" 2026-10-30T23:07:45.118128Z info FLAG: --tokenManagerPlugin="" 2026-10-30T23:07:45.118131Z info FLAG: --vklog="0" 2026-10-30T23:07:45.118134Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T23:07:45.118329Z info Proxy role ips=[10.132.1.11] type=router id=maas-default-gateway-openshift-default-6db586dd6c-jp9lg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T23:07:45.118390Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T23:07:45.119615Z info cpu limit detected as 2, setting concurrency 2026-10-30T23:07:45.119876Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T23:07:45.119888Z info JWT policy is third-party-jwt 2026-10-30T23:07:45.119892Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T23:07:45.122098Z info Starting default Istio SDS Server 2026-10-30T23:07:45.122127Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T23:07:45.122168Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T23:07:45.122260Z info Opening status port 15020 2026-10-30T23:07:45.123708Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T23:07:45.124431Z info sds Starting SDS grpc server 2026-10-30T23:07:45.124448Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T23:07:45.125538Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T23:07:45.126478Z info Starting proxy agent 2026-10-30T23:07:45.126509Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T23:07:45.190427Z info cache generated new workload certificate resourceName=default latency=65.836391ms ttl=23h59m59.809577019s 2026-10-30T23:07:45.190462Z info cache Root cert has changed, start rotating root cert 2026-10-30T23:07:45.190497Z info cache returned workload trust anchor from cache ttl=23h59m59.80950395s 2026-10-30T23:07:45.207622Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T23:07:45.338368Z info ads ADS: new connection for node:1 2026-10-30T23:07:45.338460Z info cache returned workload certificate from cache ttl=23h59m59.661542263s 2026-10-30T23:07:45.338783Z info ads ADS: new connection for node:2 2026-10-30T23:07:45.339006Z info cache returned workload trust anchor from cache ttl=23h59m59.660996802s 2026-10-30T23:07:45.423511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:07:53.669814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:07:54.704415Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T23:07:55.951085Z info Readiness succeeded in 10.836473219s 2026-10-30T23:07:55.951464Z info Envoy proxy is ready 2026-10-30T23:08:06.055858Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:08:21.885208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T23:08:28.468Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 79 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a39be287-3634-4ed1-9945-2465d05a8a9e" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:59152 10.132.1.11:443 10.132.0.10:42216 - v1-completions-path [2026-10-30T23:08:28.567Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "1e89894d-8c35-97aa-9217-a1a6c192bdf5" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:59154 10.132.1.11:443 10.132.0.10:42220 - v1-completions-path 2026-10-30T23:08:45.106569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:08:55.513398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:09:00.253974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T23:09:04.415Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "b753cc62-dd19-46a7-886e-cd174b7d0af9" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:59154 10.132.1.11:443 10.132.0.10:53574 - v1-completions-path 2026-10-30T23:09:16.969121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:09:19.403048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:09:38.506813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:09:43.071360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:09:58.714536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:10:01.044092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:10:18.847769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:10:29.528514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:10:32.812543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:11:02.539075Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:11:20.523514Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:11:30.993803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:14:41.086466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:14:41.086501Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:14:41.086515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T23:14:41.086520Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T23:14:41.006Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 80 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "046e91ca-a7c2-406d-bdb5-bd221cc96e8d" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.11:53974 10.132.1.11:443 10.132.0.10:54654 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:15:01.011003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:15:16.626266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:15:19.051576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:15:25.672406Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-10-30T23:15:25.672480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:15:25.672508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:15:25.672530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:15:25.672538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T23:15:25.593Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 78 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a4991c8c-fdaf-4c6c-b827-ed3e43a2f9df" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.11:53974 10.132.1.11:443 10.132.0.10:52772 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:15:37.965784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:17:12.555909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:17:32.040667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:17:47.606275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:17:59.553690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:18:04.571155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:18:16.718276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:18:20.485317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:18:28.313646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:18:28.313685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T23:18:28.313703Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T23:18:28.313708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T23:18:28.260Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 53 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "5921ba87-d42b-4064-a427-f8787010520b" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.11:52058 10.132.1.11:443 10.132.0.10:48464 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:18:40.368045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:21:30.954395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:21:36.714505Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T23:21:36.640Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 73 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "17c83687-69fc-41b3-ae9c-204260c07f1f" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:47810 10.132.1.11:443 10.132.0.10:52348 - v1-catch-all-path 2026-10-30T23:21:39.205923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:21:44.955903Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T23:21:44.890Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 65 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "7a25906b-fea4-470f-9cb5-0ca4511957cc" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:47810 10.132.1.11:443 10.132.0.10:54062 - v1-catch-all-path [2026-10-30T23:21:45.093Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 58 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "7bab7d3f-f421-40da-a553-767b1888091b" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.11:443 10.132.0.10:54066 - v1-catch-all-path 2026-10-30T23:21:57.048962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:21:59.266785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:22:02.307061Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-10-30T23:22:02.226Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 81 - "52.71.36.72,10.132.0.10" "python-requests/2.34.2" "a7a4b16b-d5ad-4aec-b22a-75f5faf55237" "maas.apps.0ac827d9fdd4aef08717.prod.konflux-ocp-ci.dev" "10.133.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.11:47810 10.132.1.11:443 10.132.0.10:52726 - v1-catch-all-path 2026-10-30T23:22:14.185031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:22:25.433364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8