2026-11-02T01:50:26.446335Z info FLAG: --concurrency="0" 2026-11-02T01:50:26.446351Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T01:50:26.446356Z info FLAG: --help="false" 2026-11-02T01:50:26.446358Z info FLAG: --log_as_json="false" 2026-11-02T01:50:26.446360Z info FLAG: --log_caller="" 2026-11-02T01:50:26.446362Z info FLAG: --log_output_level="default:info" 2026-11-02T01:50:26.446364Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T01:50:26.446369Z info FLAG: --log_target="[stdout]" 2026-11-02T01:50:26.446371Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T01:50:26.446373Z info FLAG: --outlierLogPath="" 2026-11-02T01:50:26.446375Z info FLAG: --profiling="true" 2026-11-02T01:50:26.446377Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T01:50:26.446379Z info FLAG: --proxyLogLevel="warning" 2026-11-02T01:50:26.446381Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T01:50:26.446383Z info FLAG: --stsPort="0" 2026-11-02T01:50:26.446385Z info FLAG: --templateFile="" 2026-11-02T01:50:26.446387Z info FLAG: --tokenManagerPlugin="" 2026-11-02T01:50:26.446389Z info FLAG: --vklog="0" 2026-11-02T01:50:26.446392Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T01:50:26.446550Z info Proxy role ips=[10.132.1.26] type=router id=maas-default-gateway-openshift-default-76597d6855-dvgpc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T01:50:26.446606Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T01:50:26.447871Z info cpu limit detected as 2, setting concurrency 2026-11-02T01:50:26.448105Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T01:50:26.448117Z info JWT policy is third-party-jwt 2026-11-02T01:50:26.448121Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T01:50:26.449745Z info Starting default Istio SDS Server 2026-11-02T01:50:26.449776Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T01:50:26.449802Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T01:50:26.450326Z info Opening status port 15020 2026-11-02T01:50:26.451206Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T01:50:26.452030Z info sds Starting SDS grpc server 2026-11-02T01:50:26.452086Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T01:50:26.452650Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T01:50:26.453524Z info Starting proxy agent 2026-11-02T01:50:26.453554Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T01:50:26.523691Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T01:50:26.587538Z info cache generated new workload certificate resourceName=default latency=135.379942ms ttl=23h59m59.412466729s 2026-11-02T01:50:26.587574Z info cache Root cert has changed, start rotating root cert 2026-11-02T01:50:26.587605Z info cache returned workload trust anchor from cache ttl=23h59m59.412395651s 2026-11-02T01:50:26.639992Z info ads ADS: new connection for node:1 2026-11-02T01:50:26.640054Z info cache returned workload certificate from cache ttl=23h59m59.359949679s 2026-11-02T01:50:26.640080Z info ads ADS: new connection for node:2 2026-11-02T01:50:26.640162Z info cache returned workload trust anchor from cache ttl=23h59m59.359839388s 2026-11-02T01:50:26.730864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:50:34.656361Z info Readiness succeeded in 8.213205964s 2026-11-02T01:50:34.656822Z info Envoy proxy is ready 2026-11-02T01:51:06.801890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:51:10.419Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 85 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "f28d2544-691b-4483-bd07-4dccc2ec231a" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.26:58838 10.132.1.26:443 10.132.0.21:46862 - v1-completions-path 2026-11-02T01:51:22.714615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:25.018251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:41.468385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:51:40.945Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 92 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "531e9166-72a9-424a-abfe-35fdf44b0ccd" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.26:40094 10.132.1.26:443 10.132.0.21:43098 - v1-completions-path 2026-11-02T01:51:43.314598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:46.276164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:51:54.535730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T01:52:01.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "90875533-a07a-4613-8a98-21b27cf8c61a" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.26:58838 10.132.1.26:443 10.132.0.21:34244 - v1-completions-path 2026-11-02T01:52:02.869953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T01:52:02.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 56 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "80d0e764-7ee7-4e04-a84a-9cd66b92034d" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.26:58838 10.132.1.26:443 10.132.0.21:34266 - v1-completions-path 2026-11-02T01:52:19.229832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:29.447963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:31.145949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:36.642942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:52:36.642980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:52:36.642994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:52:36.643000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:52:36.576Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 66 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "e61654d3-3616-4fd1-9220-0e92da748174" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.26:55484 10.132.1.26:443 10.132.0.21:42602 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T01:52:37.508Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 59 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "442ff24d-c4d6-48d2-9786-e52a0eb39320" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.132.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.26:49070 10.132.1.26:443 10.132.0.21:42618 - v1-completions-path 2026-11-02T01:52:50.000435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:52:51.796634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:08.243696Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:10.376813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:27.019083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:28.713798Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:44.782004Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:55.450312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:53:58.352911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:20.612982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:34.857540Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T01:54:38.830794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:54:49.070266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:55:04.970003Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:55:07.297491Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:56:38.757393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:56:41.207415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:05.331715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:08.808142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:58:08.808177Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:58:08.808189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T01:58:08.808193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T01:58:08.744Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 63 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "1e46f949-31e4-4c51-9e86-19ff6fd92d8c" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.26:52088 10.132.1.26:443 10.132.0.21:32888 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T01:58:20.356176Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:22.086626Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:58:39.186598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T01:59:56.647136Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-02T01:59:56.647212Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:56.647233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:56.647249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T01:59:56.647254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T01:59:56.581Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 65 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "d0018b2d-a0f9-48a5-b1d9-3086f0eda61f" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.26:33242 10.132.1.26:443 10.132.0.21:57096 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:00:00.850427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:16.662089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:32.801417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:44.467935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:48.104644Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:00:48.111400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T02:00:48.111440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T02:00:48.111460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T02:00:48.111467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T02:00:48.021Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 89 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "863a957b-b868-44fd-a533-6f27f557b959" "maas.apps.9a5fa77f1b041b8d2999.prod.konflux-ocp-ci.dev" "10.134.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.26:33242 10.132.1.26:443 10.132.0.21:53086 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T02:00:59.636246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:01:01.954599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:01:19.918256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:07.524173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:12.870736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:28.130376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:29.748487Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:43.943905Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T02:04:54.700740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8