2026-11-03T18:16:02.730910Z info FLAG: --concurrency="0" 2026-11-03T18:16:02.730937Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T18:16:02.730943Z info FLAG: --help="false" 2026-11-03T18:16:02.730946Z info FLAG: --log_as_json="false" 2026-11-03T18:16:02.730949Z info FLAG: --log_caller="" 2026-11-03T18:16:02.730953Z info FLAG: --log_output_level="default:info" 2026-11-03T18:16:02.730956Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T18:16:02.730963Z info FLAG: --log_target="[stdout]" 2026-11-03T18:16:02.730967Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T18:16:02.730969Z info FLAG: --outlierLogPath="" 2026-11-03T18:16:02.730973Z info FLAG: --profiling="true" 2026-11-03T18:16:02.730976Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T18:16:02.730979Z info FLAG: --proxyLogLevel="warning" 2026-11-03T18:16:02.730982Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T18:16:02.730985Z info FLAG: --stsPort="0" 2026-11-03T18:16:02.730989Z info FLAG: --templateFile="" 2026-11-03T18:16:02.730992Z info FLAG: --tokenManagerPlugin="" 2026-11-03T18:16:02.730996Z info FLAG: --vklog="0" 2026-11-03T18:16:02.731000Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T18:16:02.731208Z info Proxy role ips=[10.132.0.164] type=router id=maas-default-gateway-openshift-default-5df48fcc99-4cj7c.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T18:16:02.731331Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T18:16:02.733700Z info cpu limit detected as 2, setting concurrency 2026-11-03T18:16:02.734194Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T18:16:02.734268Z info JWT policy is third-party-jwt 2026-11-03T18:16:02.734295Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T18:16:02.735829Z info Starting default Istio SDS Server 2026-11-03T18:16:02.735896Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T18:16:02.735985Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T18:16:02.736185Z info Opening status port 15020 2026-11-03T18:16:02.740692Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T18:16:02.743464Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T18:16:02.749888Z info sds Starting SDS grpc server 2026-11-03T18:16:02.749911Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T18:16:02.750067Z info Starting proxy agent 2026-11-03T18:16:02.750108Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T18:16:02.856795Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T18:16:03.237347Z info cache generated new workload certificate resourceName=default latency=488.800992ms ttl=23h59m59.762659937s 2026-11-03T18:16:03.237481Z info cache Root cert has changed, start rotating root cert 2026-11-03T18:16:03.237554Z info cache returned workload trust anchor from cache ttl=23h59m59.762447283s 2026-11-03T18:16:03.296715Z info ads ADS: new connection for node:1 2026-11-03T18:16:03.296791Z info cache returned workload certificate from cache ttl=23h59m59.703211004s 2026-11-03T18:16:03.296879Z info ads ADS: new connection for node:2 2026-11-03T18:16:03.296973Z info cache returned workload trust anchor from cache ttl=23h59m59.703028611s 2026-11-03T18:16:03.411637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:16:12.621019Z info Readiness succeeded in 9.902725878s 2026-11-03T18:16:12.621598Z info Envoy proxy is ready 2026-11-03T18:16:41.234475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:20:37.494159Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T18:22:53.393950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:22:53.393991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:22:53.394005Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:22:53.394010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T18:22:53.200Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 193 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f24d27eb-38b1-459c-bf5b-b9d344971895" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.134.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.164:46186 10.132.0.164:443 10.132.0.12:49674 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:22:58.872787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:23:25.573353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:24.570188Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:45.940432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:24:50.871738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:25:02.760Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 74 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "1d6bfe0a-de8e-4857-a47a-567903ab5341" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.164:56162 10.132.0.164:443 10.132.0.12:51652 - v1-completions-path 2026-11-03T18:25:21.076305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:25:34.407215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:05.303531Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:16.105008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:22.817407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:26:36.657Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "04df5507-53ab-4ba9-9509-17dab2375963" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.39:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.164:56162 10.132.0.164:443 10.132.0.12:48308 - v1-completions-path 2026-11-03T18:26:54.241731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:26:59.176694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-03T18:27:11.808Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 74 292 81 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "b0e19348-621c-4cf9-9842-939e058aa991" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.38:8000" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local 10.132.0.164:42712 10.132.0.164:443 10.132.0.12:40242 - v1-completions-path 2026-11-03T18:27:25.721154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:27:32.430456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:01.414311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:23.521132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:36.666821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:28:42.730467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:07.474353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:13.216848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:34.555258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:29:56.190364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:06.995407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:26.054998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:30:32.048444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:32:54.966545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:33:01.234399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:41.364135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:34:45.187876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:34:45.187915Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:34:45.187928Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:34:45.187935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T18:34:45.070Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 117 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "6fd74663-3a78-4665-bf0e-f619a104d358" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.134.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.164:56604 10.132.0.164:443 10.132.0.12:34896 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:34:58.812397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:03.593678Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:35:13.879425Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T18:35:13.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 81 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "a79b0bcb-8786-47ab-b26e-30330e88f546" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.132.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.164:56900 10.132.0.164:443 10.132.0.12:43024 - v1-completions-path 2026-11-03T18:35:27.972732Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:37:34.839077Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:38:20.809347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:38:48.096783Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:03.663526Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:21.737400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:39:21.737434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:39:21.737446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T18:39:21.737450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T18:39:21.679Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 58 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "7089dc15-54c1-4d4f-a122-811262c3d98d" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.134.0.46:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.164:60980 10.132.0.164:443 10.132.0.12:46478 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:39:22.736364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:35.257189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:39:40.136023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:40:07.996290Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:43:53.631710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:00.027508Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-11-03T18:43:59.942Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 85 - "52.71.36.72,10.132.0.12" "python-requests/2.34.2" "f36d36ca-a7b3-4a59-809b-7e56decc9c46" "maas.apps.dce9fa1a3e5c51517870.prod.konflux-ocp-ci.dev" "10.134.0.49:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.164:35676 10.132.0.164:443 10.132.0.12:38544 - v1-catch-all-path 2026-11-03T18:44:05.197349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:26.373237Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:31.129913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:44:48.481889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-03T18:45:00.305264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9