2026-11-03T20:04:19.050829Z info FLAG: --concurrency="0" 2026-11-03T20:04:19.050848Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T20:04:19.050852Z info FLAG: --help="false" 2026-11-03T20:04:19.050854Z info FLAG: --log_as_json="false" 2026-11-03T20:04:19.050856Z info FLAG: --log_caller="" 2026-11-03T20:04:19.050858Z info FLAG: --log_output_level="default:info" 2026-11-03T20:04:19.050860Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T20:04:19.050865Z info FLAG: --log_target="[stdout]" 2026-11-03T20:04:19.050867Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T20:04:19.050869Z info FLAG: --outlierLogPath="" 2026-11-03T20:04:19.050871Z info FLAG: --profiling="true" 2026-11-03T20:04:19.050873Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T20:04:19.050875Z info FLAG: --proxyLogLevel="warning" 2026-11-03T20:04:19.050877Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T20:04:19.050879Z info FLAG: --stsPort="0" 2026-11-03T20:04:19.050881Z info FLAG: --templateFile="" 2026-11-03T20:04:19.050883Z info FLAG: --tokenManagerPlugin="" 2026-11-03T20:04:19.050885Z info FLAG: --vklog="0" 2026-11-03T20:04:19.050888Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T20:04:19.051036Z info Proxy role ips=[10.134.0.52] type=router id=maas-default-gateway-openshift-default-67bf986f99-88lvc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T20:04:19.051084Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T20:04:19.052111Z info cpu limit detected as 2, setting concurrency 2026-11-03T20:04:19.052337Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T20:04:19.052349Z info JWT policy is third-party-jwt 2026-11-03T20:04:19.052352Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T20:04:19.053946Z info Starting default Istio SDS Server 2026-11-03T20:04:19.053974Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T20:04:19.053999Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T20:04:19.054157Z info Opening status port 15020 2026-11-03T20:04:19.055237Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T20:04:19.055761Z info sds Starting SDS grpc server 2026-11-03T20:04:19.055880Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T20:04:19.056706Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T20:04:19.057476Z info Starting proxy agent 2026-11-03T20:04:19.057507Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T20:04:19.113162Z info cache generated new workload certificate resourceName=default latency=57.20514ms ttl=23h59m59.886841914s 2026-11-03T20:04:19.113213Z info cache Root cert has changed, start rotating root cert 2026-11-03T20:04:19.113245Z info cache returned workload trust anchor from cache ttl=23h59m59.886755287s 2026-11-03T20:04:19.122101Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T20:04:19.222905Z info ads ADS: new connection for node:1 2026-11-03T20:04:19.222984Z info cache returned workload certificate from cache ttl=23h59m59.777018282s 2026-11-03T20:04:19.223363Z info ads ADS: new connection for node:2 2026-11-03T20:04:19.223442Z info cache returned workload trust anchor from cache ttl=23h59m59.776559094s 2026-11-03T20:04:19.316933Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:29.474121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:30.233346Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T20:04:30.683343Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T20:04:31.692331Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T20:04:33.296710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:34.283774Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T20:04:34.787802Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T20:04:35.803691Z info Readiness succeeded in 16.755778843s 2026-11-03T20:04:35.804004Z info Envoy proxy is ready 2026-11-03T20:04:44.063221Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:04:54.200029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:04.445386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:09.046545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:12.793673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:16.794269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:05:25.725843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:05:25.725880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:05:25.725893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:05:25.725897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:05:25.655Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 83 325 70 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "3726a40b-aae0-4509-a7c7-cad043e1b1f8" "maas.apps.93c989c08f3213195ddb.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:47622 10.134.0.52:443 10.132.0.15:59912 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:07:02.766510Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:09.689569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:13.973774Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:29.962433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:40.269313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:50.443109Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:54.641147Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:00.635511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:06.021923Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:08:24.623Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 35 0 34 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "fe0e8916-1303-4964-8b28-087ad263ded4" "maas.apps.93c989c08f3213195ddb.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.52:443 10.132.0.15:41996 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:08:29.718Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 35 0 36 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "ac607db1-518d-4cff-be81-0434467564ab" "maas.apps.93c989c08f3213195ddb.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.52:443 10.132.0.15:42958 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:08:41.300169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:41.300232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:41.300243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:08:41.300248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:08:41.235Z] "GET /v1/api-keys/13ae88fb-2f19-43ed-8280-491b032f60c2 HTTP/1.1" 404 - via_upstream - "-" 0 29 64 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "7a436b14-309d-4c17-aa2f-2babb7602b21" "maas.apps.93c989c08f3213195ddb.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:47290 10.134.0.52:443 10.132.0.15:52760 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:08:42.054576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:08:42.054612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:08:42.054626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:08:42.054631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:08:41.975Z] "GET /v1/api-keys/b9d6505f-a0ea-4560-8ba4-d01c5c941845 HTTP/1.1" 200 - via_upstream - "-" 0 332 78 - "34.228.250.194,10.132.0.15" "python-requests/2.34.2" "e80ed95c-0736-4bdb-a26f-c25accd23073" "maas.apps.93c989c08f3213195ddb.prod.konflux-ocp-ci.dev" "10.133.0.29:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.52:47300 10.134.0.52:443 10.132.0.15:52766 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:08:58.285573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:02.620964Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:17.998757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:28.313146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:38.500374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:43.360266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8