2026-10-30T05:41:05.388318Z info FLAG: --concurrency="0" 2026-10-30T05:41:05.388336Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T05:41:05.388340Z info FLAG: --help="false" 2026-10-30T05:41:05.388343Z info FLAG: --log_as_json="false" 2026-10-30T05:41:05.388345Z info FLAG: --log_caller="" 2026-10-30T05:41:05.388347Z info FLAG: --log_output_level="default:info" 2026-10-30T05:41:05.388349Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T05:41:05.388354Z info FLAG: --log_target="[stdout]" 2026-10-30T05:41:05.388356Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T05:41:05.388358Z info FLAG: --outlierLogPath="" 2026-10-30T05:41:05.388360Z info FLAG: --profiling="true" 2026-10-30T05:41:05.388363Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T05:41:05.388365Z info FLAG: --proxyLogLevel="warning" 2026-10-30T05:41:05.388367Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T05:41:05.388369Z info FLAG: --stsPort="0" 2026-10-30T05:41:05.388371Z info FLAG: --templateFile="" 2026-10-30T05:41:05.388373Z info FLAG: --tokenManagerPlugin="" 2026-10-30T05:41:05.388375Z info FLAG: --vklog="0" 2026-10-30T05:41:05.388378Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T05:41:05.388518Z info Proxy role ips=[10.132.1.2] type=router id=maas-default-gateway-openshift-default-6f77ddbcb7-68n2k.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T05:41:05.388569Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T05:41:05.389640Z info cpu limit detected as 2, setting concurrency 2026-10-30T05:41:05.389827Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T05:41:05.389838Z info JWT policy is third-party-jwt 2026-10-30T05:41:05.389841Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T05:41:05.391445Z info Starting default Istio SDS Server 2026-10-30T05:41:05.391466Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T05:41:05.391485Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T05:41:05.391739Z info Opening status port 15020 2026-10-30T05:41:05.392715Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T05:41:05.393723Z info sds Starting SDS grpc server 2026-10-30T05:41:05.393808Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T05:41:05.394042Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T05:41:05.394886Z info Starting proxy agent 2026-10-30T05:41:05.394916Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T05:41:05.458462Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T05:41:05.477562Z info cache generated new workload certificate resourceName=default latency=83.662727ms ttl=23h59m59.522443041s 2026-10-30T05:41:05.477603Z info cache Root cert has changed, start rotating root cert 2026-10-30T05:41:05.477656Z info cache returned workload trust anchor from cache ttl=23h59m59.522346393s 2026-10-30T05:41:05.568896Z info ads ADS: new connection for node:1 2026-10-30T05:41:05.568964Z info cache returned workload certificate from cache ttl=23h59m59.431037327s 2026-10-30T05:41:05.569127Z info ads ADS: new connection for node:2 2026-10-30T05:41:05.569203Z info cache returned workload trust anchor from cache ttl=23h59m59.430798568s 2026-10-30T05:41:05.651129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:41:13.608569Z info Readiness succeeded in 8.222544872s 2026-10-30T05:41:13.608982Z info Envoy proxy is ready 2026-10-30T05:41:15.926044Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:41:50.668531Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:41:50.668587Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:41:50.668607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:41:50.668614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:41:50.578Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 90 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "d9f55188-cc1f-4426-ad7b-3261cc8d4c10" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.2:35098 10.132.1.2:443 10.132.0.15:57206 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:41:54.951353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:14.004123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:18.151817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:34.421012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:42:50.151135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T05:42:56.224Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "1df418ad-eb09-4968-a8fe-9b8f338ea819" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.2:59718 10.132.1.2:443 10.132.0.15:55254 - v1-completions-path [2026-10-30T05:42:57.897Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "fc4b27e5-4e4f-4aa4-b079-229d16138c74" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.46:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.2:59718 10.132.1.2:443 10.132.0.15:55264 - v1-completions-path 2026-10-30T05:43:14.290276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:24.677535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:29.147248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:46.813586Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:43:48.988529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:05.522851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:10.287264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:27.585995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:44.700153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:55.380763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:44:58.236856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:45:14.465969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T05:45:14.458Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 38 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "aaf8ed9e-e152-4116-8a71-a7c6d174e5cc" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.2:443 10.132.0.15:51124 - v1-completions-path 2026-10-30T05:45:16.391365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:45:19.019071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:45:26.519184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:45:26.519244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:45:26.519260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:45:26.519265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:45:26.446Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 72 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "d87b15aa-6fc6-4606-8853-46914d9cd019" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.132.0.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.2:44650 10.132.1.2:443 10.132.0.15:37896 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:48:21.834708Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:48:21.834738Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:48:21.834741Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:48:21.834745Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T05:48:21.786Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 47 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "cdd059a4-e266-45a4-a517-27b03c5ca316" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.2:443 10.132.0.15:56480 - v1-completions-path 2026-10-30T05:48:42.678365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:48:57.918936Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:48:59.875576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:49:14.456434Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:50:31.495986Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:50:49.432212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:04.383810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:18.481998Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:22.263153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:33.722609Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:37.229585Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:51:57.088294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:04.788924Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:52:04.788954Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:52:04.788958Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T05:52:04.788964Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T05:52:04.721Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 67 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "b3df2e25-c3ef-494e-85b6-72e84f3cc1a5" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.2:443 10.132.0.15:36980 - v1-catch-all-path 2026-10-30T05:52:06.973500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:15.300276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:20.760802Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T05:52:20.667Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 93 - "52.71.36.72,10.132.0.15" "python-requests/2.34.2" "3bab7b7b-ab26-4dcc-9a4c-45e59da16b2b" "maas.apps.70853b44304d2f3542e7.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.2:47504 10.132.1.2:443 10.132.0.15:40952 - v1-catch-all-path 2026-10-30T05:52:33.126502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:35.373180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:52:49.876924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T05:53:00.885534Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8