2026-11-03T18:08:56.201744Z info FLAG: --concurrency="0" 2026-11-03T18:08:56.201761Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T18:08:56.201765Z info FLAG: --help="false" 2026-11-03T18:08:56.201768Z info FLAG: --log_as_json="false" 2026-11-03T18:08:56.201770Z info FLAG: --log_caller="" 2026-11-03T18:08:56.201772Z info FLAG: --log_output_level="default:info" 2026-11-03T18:08:56.201774Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T18:08:56.201779Z info FLAG: --log_target="[stdout]" 2026-11-03T18:08:56.201781Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T18:08:56.201783Z info FLAG: --outlierLogPath="" 2026-11-03T18:08:56.201785Z info FLAG: --profiling="true" 2026-11-03T18:08:56.201787Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T18:08:56.201789Z info FLAG: --proxyLogLevel="warning" 2026-11-03T18:08:56.201791Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T18:08:56.201793Z info FLAG: --stsPort="0" 2026-11-03T18:08:56.201795Z info FLAG: --templateFile="" 2026-11-03T18:08:56.201797Z info FLAG: --tokenManagerPlugin="" 2026-11-03T18:08:56.201799Z info FLAG: --vklog="0" 2026-11-03T18:08:56.201802Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T18:08:56.201933Z info Proxy role ips=[10.134.0.87] type=router id=maas-default-gateway-openshift-default-6dcf757899-6stkz.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T18:08:56.201976Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T18:08:56.202959Z info cpu limit detected as 2, setting concurrency 2026-11-03T18:08:56.203143Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T18:08:56.203154Z info JWT policy is third-party-jwt 2026-11-03T18:08:56.203157Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T18:08:56.204819Z info Starting default Istio SDS Server 2026-11-03T18:08:56.204837Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T18:08:56.204859Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T18:08:56.204995Z info Opening status port 15020 2026-11-03T18:08:56.206102Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T18:08:56.207576Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T18:08:56.208338Z info Starting proxy agent 2026-11-03T18:08:56.208373Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T18:08:56.217033Z info sds Starting SDS grpc server 2026-11-03T18:08:56.217053Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T18:08:56.279186Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T18:08:56.325605Z info cache generated new workload certificate resourceName=default latency=119.307531ms ttl=23h59m59.674397908s 2026-11-03T18:08:56.325640Z info cache Root cert has changed, start rotating root cert 2026-11-03T18:08:56.325678Z info cache returned workload trust anchor from cache ttl=23h59m59.674323175s 2026-11-03T18:08:56.509046Z info ads ADS: new connection for node:1 2026-11-03T18:08:56.509117Z info cache returned workload certificate from cache ttl=23h59m59.490885248s 2026-11-03T18:08:56.510484Z info ads ADS: new connection for node:2 2026-11-03T18:08:56.510564Z info cache returned workload trust anchor from cache ttl=23h59m59.489437956s 2026-11-03T18:08:56.605677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:09:05.222240Z info Readiness succeeded in 9.023079331s 2026-11-03T18:09:05.222751Z info Envoy proxy is ready 2026-11-03T18:09:05.889733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:10:17.875842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:12:31.151808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:18:43.431355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:19:29.861332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:19:49.446675Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T18:20:14.638262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:20:44.236442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:20:53.412558Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:20:53.412592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:20:53.412605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T18:20:53.412610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T18:20:53.287Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 124 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "76cce781-4c63-9bc9-a58d-b36a8aabcec8" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.87:56002 10.134.0.87:443 10.132.0.17:60930 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:21:37.961273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:21:59.234670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:22:04.082741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:22:17.001071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:17.001110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T18:22:17.001128Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T18:22:17.001134Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T18:22:16.930Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 70 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "56b9a130-3489-4210-8a57-13f6488640ca" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:37504 10.134.0.87:443 10.132.0.17:54984 - v1-catch-all-path 2026-11-03T18:22:30.605448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:22:47.561519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T18:22:58.063Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "6ddf783b-b10d-4e7a-8812-a9b978b17a1a" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:37504 10.134.0.87:443 10.132.0.17:53762 - v1-completions-path 2026-11-03T18:23:18.664558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:23:29.422981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:23:36.054261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:23:50.820721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T18:23:50.760Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "932523d8-e0f2-4b8b-a163-af5ceed678ba" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:37504 10.134.0.87:443 10.132.0.17:51386 - v1-completions-path 2026-11-03T18:24:04.446427Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:24:09.094618Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:24:32.729168Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:24:39.183260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:25:05.302802Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:25:24.484220Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:25:37.482494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T18:26:01.626Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 39 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "2256984d-aaab-45d9-ab19-7726f9d7816d" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.87:443 10.132.0.17:49494 - v1-completions-path 2026-11-03T18:26:10.581342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:26:32.381578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:26:43.083025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:30:54.746559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T18:30:57.278Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 211 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "33df807d-cfda-45e2-9f5a-e7b81a413418" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.133.0.23:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:35676 10.134.0.87:443 10.132.0.17:45776 - v1-completions-path 2026-11-03T18:31:12.021324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:31:16.638031Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:31:41.271186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:33:49.762733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:34:30.615785Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:34:48.641604Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:35:03.860992Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:35:22.243329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:35:34.643273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:35:39.568539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:35:50.370820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:50.370861Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:50.370877Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:50.370882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T18:35:50.245Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 125 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "44bc9ae5-632d-429c-8bc7-c5b8222add8f" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.87:40912 10.134.0.87:443 10.132.0.17:36652 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:35:51.992305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:51.992343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:51.992359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T18:35:51.992364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T18:35:51.123Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 64 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3aa208b5-c69a-4ac5-9847-a4e6e18b6b00" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:56360 10.134.0.87:443 10.132.0.17:36664 - v1-completions-path [2026-11-03T18:35:51.941Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 51 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "3528fcac-2840-48a0-b665-80752fad8b6a" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.51:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.87:40912 10.134.0.87:443 10.132.0.17:36670 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T18:36:05.464738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:39:39.867143Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:39:50.160210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:39:57.162083Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-03T18:39:57.180131Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-03T18:39:57.104Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 76 - "34.228.250.194,10.132.0.17" "python-requests/2.34.2" "37a65f7c-fff0-45a5-b19e-78edfdbe9f6f" "maas.apps.cf6b40c5a7171fca2212.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.87:54046 10.134.0.87:443 10.132.0.17:54308 - v1-catch-all-path 2026-11-03T18:40:11.195545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:40:15.917920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:40:32.183543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T18:40:44.007771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8