2026-11-04T01:54:27.034561Z info FLAG: --concurrency="0" 2026-11-04T01:54:27.034579Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T01:54:27.034583Z info FLAG: --help="false" 2026-11-04T01:54:27.034585Z info FLAG: --log_as_json="false" 2026-11-04T01:54:27.034587Z info FLAG: --log_caller="" 2026-11-04T01:54:27.034589Z info FLAG: --log_output_level="default:info" 2026-11-04T01:54:27.034591Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T01:54:27.034598Z info FLAG: --log_target="[stdout]" 2026-11-04T01:54:27.034602Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T01:54:27.034605Z info FLAG: --outlierLogPath="" 2026-11-04T01:54:27.034607Z info FLAG: --profiling="true" 2026-11-04T01:54:27.034610Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T01:54:27.034631Z info FLAG: --proxyLogLevel="warning" 2026-11-04T01:54:27.034635Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T01:54:27.034638Z info FLAG: --stsPort="0" 2026-11-04T01:54:27.034641Z info FLAG: --templateFile="" 2026-11-04T01:54:27.034645Z info FLAG: --tokenManagerPlugin="" 2026-11-04T01:54:27.034649Z info FLAG: --vklog="0" 2026-11-04T01:54:27.034652Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T01:54:27.034830Z info Proxy role ips=[10.134.0.38] type=router id=maas-default-gateway-openshift-default-84587756dc-h8rpd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T01:54:27.034896Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T01:54:27.036781Z info cpu limit detected as 2, setting concurrency 2026-11-04T01:54:27.037179Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T01:54:27.037195Z info JWT policy is third-party-jwt 2026-11-04T01:54:27.037199Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T01:54:27.040450Z info Opening status port 15020 2026-11-04T01:54:27.040484Z info Starting default Istio SDS Server 2026-11-04T01:54:27.040518Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T01:54:27.040536Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T01:54:27.041201Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T01:54:27.041973Z info sds Starting SDS grpc server 2026-11-04T01:54:27.041989Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T01:54:27.042725Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T01:54:27.043695Z info Starting proxy agent 2026-11-04T01:54:27.043725Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T01:54:27.116021Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T01:54:27.149729Z info cache generated new workload certificate resourceName=default latency=107.574715ms ttl=23h59m59.850275172s 2026-11-04T01:54:27.149768Z info cache Root cert has changed, start rotating root cert 2026-11-04T01:54:27.149802Z info cache returned workload trust anchor from cache ttl=23h59m59.850198756s 2026-11-04T01:54:27.228338Z info ads ADS: new connection for node:1 2026-11-04T01:54:27.228415Z info ads ADS: new connection for node:2 2026-11-04T01:54:27.228418Z info cache returned workload trust anchor from cache ttl=23h59m59.77158295s 2026-11-04T01:54:27.228535Z info cache returned workload certificate from cache ttl=23h59m59.771466328s 2026-11-04T01:54:27.317893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:54:35.639046Z info Readiness succeeded in 8.607536857s 2026-11-04T01:54:35.639347Z info Envoy proxy is ready [2026-11-04T01:57:06.757Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 50 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "8f4dd730-5251-4a58-8e56-bcad5e140132" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.38:443 10.132.0.14:40642 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T01:57:12.555Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 2063 86 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "1b942062-c5f3-4713-a437-51843e03e014" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:57136 10.134.0.38:443 10.132.0.14:40646 - v1-chat-completions-path 2026-11-04T01:58:15.782368Z info ads ADS: new connection for node:3 2026-11-04T01:58:15.789683Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T01:58:15.789803Z info cache read certificate from file resource=file-root:system 2026-11-04T01:58:17.386946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:23.859762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:58:59.509262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T01:59:04.727759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:59:04.727793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:59:04.727806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:59:04.727811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T01:59:04.644Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 83 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "2e61bd8e-1fb7-4bf0-9e40-92e6d44f1d0a" "maas.apps.d27b3b2b39e35a745199.prod.konflux-ocp-ci.dev" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:36734 10.134.0.38:443 10.132.0.14:35136 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T01:59:04.900571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:59:04.900605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:59:04.900646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T01:59:04.900653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T01:59:04.900846Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-04T01:59:04.754Z] "POST /anything/e2e-dft-b37ea0-f05056 HTTP/1.1" 200 - via_upstream - "-" 109 1590 146 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "5465f3f1-b57b-4757-9a4b-38ca1a014683" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.38:35340 10.134.0.38:443 10.132.0.14:35148 - llm.external-model-e2e-dft-b37ea0-a11563f39ce1.0 2026-11-04T01:59:28.962121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:05.904597Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:23.870342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:00:42.309685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:01:36.796464Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T02:01:51.920720Z info ads ADS: new connection for node:4 2026-11-04T02:01:51.926838Z info cache read certificate from file resource=file-root:system 2026-11-04T02:01:53.421282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:00.396963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:19.107298Z info ads ADS: "" 4 terminated with stream closed 2026-11-04T02:02:19.159782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:22.337602Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:02:36.247268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8