2026-10-30T17:20:10.043700Z info FLAG: --concurrency="0" 2026-10-30T17:20:10.044529Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T17:20:10.044552Z info FLAG: --help="false" 2026-10-30T17:20:10.044557Z info FLAG: --log_as_json="false" 2026-10-30T17:20:10.044561Z info FLAG: --log_caller="" 2026-10-30T17:20:10.044564Z info FLAG: --log_output_level="default:info" 2026-10-30T17:20:10.044568Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T17:20:10.044575Z info FLAG: --log_target="[stdout]" 2026-10-30T17:20:10.044602Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T17:20:10.044606Z info FLAG: --outlierLogPath="" 2026-10-30T17:20:10.044609Z info FLAG: --profiling="true" 2026-10-30T17:20:10.044613Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T17:20:10.044617Z info FLAG: --proxyLogLevel="warning" 2026-10-30T17:20:10.044620Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T17:20:10.044625Z info FLAG: --stsPort="0" 2026-10-30T17:20:10.044628Z info FLAG: --templateFile="" 2026-10-30T17:20:10.044632Z info FLAG: --tokenManagerPlugin="" 2026-10-30T17:20:10.044636Z info FLAG: --vklog="0" 2026-10-30T17:20:10.044641Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T17:20:10.044846Z info Proxy role ips=[10.132.0.236] type=router id=maas-default-gateway-openshift-default-76f4876667-9kbt9.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T17:20:10.044927Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T17:20:10.046924Z info cpu limit detected as 2, setting concurrency 2026-10-30T17:20:10.047288Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T17:20:10.047306Z info JWT policy is third-party-jwt 2026-10-30T17:20:10.047311Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T17:20:10.049183Z info Starting default Istio SDS Server 2026-10-30T17:20:10.049208Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T17:20:10.049234Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T17:20:10.049438Z info Opening status port 15020 2026-10-30T17:20:10.051081Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T17:20:10.054491Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T17:20:10.060991Z info Starting proxy agent 2026-10-30T17:20:10.061040Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T17:20:10.058849Z info sds Starting SDS grpc server 2026-10-30T17:20:10.072618Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T17:20:10.112684Z info cache generated new workload certificate resourceName=default latency=55.029497ms ttl=23h59m59.887318713s 2026-10-30T17:20:10.112718Z info cache Root cert has changed, start rotating root cert 2026-10-30T17:20:10.112750Z info cache returned workload trust anchor from cache ttl=23h59m59.887250677s 2026-10-30T17:20:10.176781Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T17:20:10.319860Z info ads ADS: new connection for node:1 2026-10-30T17:20:10.319975Z info cache returned workload certificate from cache ttl=23h59m59.680026129s 2026-10-30T17:20:10.320684Z info ads ADS: new connection for node:2 2026-10-30T17:20:10.320757Z info cache returned workload trust anchor from cache ttl=23h59m59.679244632s 2026-10-30T17:20:10.434082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:20:18.579122Z info Readiness succeeded in 8.543295739s 2026-10-30T17:20:18.579525Z info Envoy proxy is ready 2026-10-30T17:20:24.798481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:20:50.235438Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-10-30T17:20:56.547Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 66 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "70b437f8-388d-47de-aa8c-33cadef41fd8" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.236:443 10.132.0.12:60938 - v1-completions-path [2026-10-30T17:20:56.635Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 73 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "21c83396-6c2e-42af-852e-f59428e253fd" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.236:38158 10.132.0.236:443 10.132.0.12:60942 - v1-completions-path 2026-10-30T17:21:23.807072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:21:34.110270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:21:38.256922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:21:43.426383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:21:43.426424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:21:43.426438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:21:43.426443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T17:21:43.346Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 80 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "88716f7d-2d3b-4772-b0e9-2b3e48965f44" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.236:37334 10.132.0.236:443 10.132.0.12:58914 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:21:43.733Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 60 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "17201145-b42a-48b2-b558-11a61c1b3958" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.52:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.236:42612 10.132.0.236:443 10.132.0.12:58924 - v1-completions-path 2026-10-30T17:21:56.596747Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:21:58.759329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:22:18.077489Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:22:23.104014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:22:38.357266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:22:40.450386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:22:59.478900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:23:10.329854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:23:21.168535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:23:41.472768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:23:41.472804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:23:41.472816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T17:23:41.472821Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T17:23:41.399Z] "DELETE /v1/api-keys/2d9c8296-6aaf-4dbb-b1a4-cf75638c68a1 HTTP/1.1" 404 - via_upstream - "-" 0 29 73 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f2cda954-f546-406a-87c6-bbb61c746cf8" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.236:40622 10.132.0.236:443 10.132.0.12:33524 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:25:50.174152Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:25:53.237464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:27:14.750682Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T17:27:14.750709Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T17:27:14.750712Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T17:27:14.750716Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T17:27:14.707Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 42 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "2684e1e4-3a48-464d-8caa-26f50d0ed265" "maas.apps.e770edb4256caa1e91a9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.236:443 10.132.0.12:36486 - v1-completions-path 2026-10-30T17:27:34.267752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:27:49.080058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:27:51.307690Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:28:06.189461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:29:56.498173Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:30:16.972824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:30:31.992593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:30:49.781083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:30:54.836676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:31:06.208668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:31:09.872913Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:31:31.250463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:31:41.270921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:31:49.481221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:32:02.856879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:32:05.132636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:32:25.309332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-10-30T17:32:36.172450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9