2026-11-03T23:39:36.589524Z info FLAG: --concurrency="0" 2026-11-03T23:39:36.589541Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T23:39:36.589545Z info FLAG: --help="false" 2026-11-03T23:39:36.589547Z info FLAG: --log_as_json="false" 2026-11-03T23:39:36.589549Z info FLAG: --log_caller="" 2026-11-03T23:39:36.589551Z info FLAG: --log_output_level="default:info" 2026-11-03T23:39:36.589553Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T23:39:36.589558Z info FLAG: --log_target="[stdout]" 2026-11-03T23:39:36.589560Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T23:39:36.589562Z info FLAG: --outlierLogPath="" 2026-11-03T23:39:36.589564Z info FLAG: --profiling="true" 2026-11-03T23:39:36.589566Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T23:39:36.589568Z info FLAG: --proxyLogLevel="warning" 2026-11-03T23:39:36.589571Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T23:39:36.589573Z info FLAG: --stsPort="0" 2026-11-03T23:39:36.589575Z info FLAG: --templateFile="" 2026-11-03T23:39:36.589577Z info FLAG: --tokenManagerPlugin="" 2026-11-03T23:39:36.589579Z info FLAG: --vklog="0" 2026-11-03T23:39:36.589582Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T23:39:36.589769Z info Proxy role ips=[10.134.0.43] type=router id=maas-default-gateway-openshift-default-855f9574cf-964xb.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T23:39:36.589817Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T23:39:36.591042Z info cpu limit detected as 2, setting concurrency 2026-11-03T23:39:36.591281Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T23:39:36.591292Z info JWT policy is third-party-jwt 2026-11-03T23:39:36.591295Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T23:39:36.593251Z info Starting default Istio SDS Server 2026-11-03T23:39:36.593272Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T23:39:36.593295Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T23:39:36.593662Z info Opening status port 15020 2026-11-03T23:39:36.594783Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T23:39:36.595654Z info sds Starting SDS grpc server 2026-11-03T23:39:36.595688Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T23:39:36.596365Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T23:39:36.597189Z info Starting proxy agent 2026-11-03T23:39:36.597249Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T23:39:36.659880Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T23:39:36.861000Z info ads ADS: new connection for node:1 2026-11-03T23:39:36.861582Z info ads ADS: new connection for node:2 2026-11-03T23:39:36.882068Z info cache generated new workload certificate resourceName=default latency=286.186023ms ttl=23h59m59.117935044s 2026-11-03T23:39:36.882099Z info cache Root cert has changed, start rotating root cert 2026-11-03T23:39:36.882134Z info cache returned workload trust anchor from cache ttl=23h59m59.117865963s 2026-11-03T23:39:36.882148Z info cache returned workload certificate from cache ttl=23h59m59.117852648s 2026-11-03T23:39:36.882247Z info cache returned workload trust anchor from cache ttl=23h59m59.117756641s 2026-11-03T23:39:36.882500Z info cache returned workload trust anchor from cache ttl=23h59m59.117501105s 2026-11-03T23:39:36.961632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:39:44.720199Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:39:45.662745Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T23:39:45.998141Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-03T23:39:46.800374Z info Readiness succeeded in 10.213850258s 2026-11-03T23:39:46.800700Z info Envoy proxy is ready [2026-11-03T23:40:18.768Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 385 88 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "361711e3-a964-497c-a1c9-0999c52779bc" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.134.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.43:46248 10.134.0.43:443 10.132.0.19:36432 - v1-model-routing [2026-11-03T23:40:19.664Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 59 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "47e14395-492f-44d1-b292-3d944bb8454f" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.19:36454 - v1-model-routing [2026-11-03T23:40:20.295Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 91 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "ec14cbbb-36dc-46f3-abe1-c1204d64a861" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.19:36462 - v1-model-routing [2026-11-03T23:40:20.878Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 59 - "34.228.250.194,10.132.0.19" "curl/7.76.1" "03faea0d-41e2-423b-8d24-ae79cf9fd070" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.43:443 10.132.0.19:36468 - v1-model-routing 2026-11-03T23:41:07.847940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:41:31.472632Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:41:52.629188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:41:52.629240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:41:52.629268Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:41:52.629273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T23:41:52.563Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 2205 65 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "0948b6ec-bc96-4f20-b918-880c38f5cfa3" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:45630 10.134.0.43:443 10.132.0.19:47836 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T23:42:10.778280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:42:16.669648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:42:30.798978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:42:41.661291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:42:52.417848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:42:58.048348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:43:04.776815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:43:26.341784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:46:26.278059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T23:46:26.278099Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T23:46:26.278115Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T23:46:26.278123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T23:46:26.212Z] "POST /v1/api-keys/bulk-revoke HTTP/1.1" 403 - via_upstream - "-" 75 83 65 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "8d327d62-21dc-41e9-bfa1-4276988f993c" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:35550 10.134.0.43:443 10.132.0.19:51840 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T23:47:03.241772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:47:09.502630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:47:21.394299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:47:38.217975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:47:58.813138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:48:14.684601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:48:26.200743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:48:48.424053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:48:54.915973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:49:15.890824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T23:49:15.890859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T23:49:15.890873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T23:49:15.890878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T23:49:15.824Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 329 65 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "d61a7134-0737-488e-b232-f90de2f24f98" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:41988 10.134.0.43:443 10.132.0.19:53178 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T23:49:49.377183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:49:49.377220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:49:49.377233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T23:49:49.377237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T23:49:49.311Z] "GET /v1/api-keys/445745eb-325e-441a-976b-1b2665860ac4 HTTP/1.1" 200 - via_upstream - "-" 0 332 65 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "68113473-55bf-412b-b23f-bd1f43351ec2" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:36840 10.134.0.43:443 10.132.0.19:60718 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T23:49:52.476335Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:49:52.476371Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T23:49:52.476384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T23:49:52.476389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T23:49:52.417Z] "GET /v1/api-keys/445745eb-325e-441a-976b-1b2665860ac4 HTTP/1.1" 200 - via_upstream - "-" 0 333 58 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "acb7cf33-c200-4d58-93a5-b01650db3013" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.43:36840 10.134.0.43:443 10.132.0.19:60728 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T23:50:12.917242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:50:19.253759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:50:23.806910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:50:43.642174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:50:54.206673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:51:10.209862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T23:51:24.962873Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T23:51:38.113Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 42 0 44 - "34.228.250.194,10.132.0.19" "python-requests/2.34.2" "7f38b325-91f9-4dec-a804-20e598ee6ce3" "maas.apps.024cb2069b50aa475a57.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.43:443 10.132.0.19:59390 - odh-ai-gateway-infra.maas-api-route.3