2026-11-04T04:54:20.641993Z info FLAG: --concurrency="0" 2026-11-04T04:54:20.642013Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T04:54:20.642019Z info FLAG: --help="false" 2026-11-04T04:54:20.642021Z info FLAG: --log_as_json="false" 2026-11-04T04:54:20.642023Z info FLAG: --log_caller="" 2026-11-04T04:54:20.642025Z info FLAG: --log_output_level="default:info" 2026-11-04T04:54:20.642027Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T04:54:20.642035Z info FLAG: --log_target="[stdout]" 2026-11-04T04:54:20.642038Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T04:54:20.642039Z info FLAG: --outlierLogPath="" 2026-11-04T04:54:20.642041Z info FLAG: --profiling="true" 2026-11-04T04:54:20.642043Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T04:54:20.642045Z info FLAG: --proxyLogLevel="warning" 2026-11-04T04:54:20.642047Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T04:54:20.642049Z info FLAG: --stsPort="0" 2026-11-04T04:54:20.642051Z info FLAG: --templateFile="" 2026-11-04T04:54:20.642053Z info FLAG: --tokenManagerPlugin="" 2026-11-04T04:54:20.642055Z info FLAG: --vklog="0" 2026-11-04T04:54:20.642058Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T04:54:20.642211Z info Proxy role ips=[10.132.0.35] type=router id=maas-default-gateway-openshift-default-6886b96f9-tl7xs.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T04:54:20.642274Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T04:54:20.643977Z info cpu limit detected as 2, setting concurrency 2026-11-04T04:54:20.644221Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T04:54:20.644234Z info JWT policy is third-party-jwt 2026-11-04T04:54:20.644238Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T04:54:20.646639Z info Opening status port 15020 2026-11-04T04:54:20.646661Z info Starting default Istio SDS Server 2026-11-04T04:54:20.647057Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T04:54:20.647080Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T04:54:20.647571Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T04:54:20.647849Z info sds Starting SDS grpc server 2026-11-04T04:54:20.647866Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T04:54:20.649028Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T04:54:20.650014Z info Starting proxy agent 2026-11-04T04:54:20.650044Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T04:54:20.719043Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T04:54:20.807200Z info cache generated new workload certificate resourceName=default latency=159.251245ms ttl=23h59m59.19280498s 2026-11-04T04:54:20.807244Z info cache Root cert has changed, start rotating root cert 2026-11-04T04:54:20.807280Z info cache returned workload trust anchor from cache ttl=23h59m59.192720234s 2026-11-04T04:54:20.869893Z info ads ADS: new connection for node:1 2026-11-04T04:54:20.869961Z info cache returned workload certificate from cache ttl=23h59m59.130040035s 2026-11-04T04:54:20.870146Z info ads ADS: new connection for node:2 2026-11-04T04:54:20.870245Z info cache returned workload trust anchor from cache ttl=23h59m59.129756732s 2026-11-04T04:54:20.913746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:54:27.346280Z info Readiness succeeded in 6.706695687s 2026-11-04T04:54:27.346635Z info Envoy proxy is ready 2026-11-04T04:56:01.104486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:05.063990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:07.781641Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:12.112351Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:19.254934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:26.887375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:31.735203Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:55.807886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:56:58.918097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-04T04:57:41.109079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:57:41.109117Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:57:41.109129Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T04:57:41.109133Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T04:57:40.938Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 170 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "27f3547b-0720-4c4d-9b96-3805f8afb3a3" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:47586 10.132.0.35:443 10.132.0.19:44368 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T04:57:41.743Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 356 79 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "39ae19aa-0723-40f6-b7b2-1ddfa693ecef" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.35:39154 10.132.0.35:443 10.132.0.19:44388 - v1-model-routing 2026-11-04T04:57:49.596838Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:57:49.596862Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:57:49.596866Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:57:49.596871Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T04:57:49.579Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "de02b30f-d483-4ce1-ada0-55c0e3238299" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.19:60654 - v1-model-routing 2026-11-04T04:57:54.260840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:57:54.260871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:57:54.260883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T04:57:54.260887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T04:57:54.153Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 106 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "dbc51f2f-91c8-424a-8a50-1270b9b70c8e" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:43234 10.132.0.35:443 10.132.0.19:47174 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T04:57:57.629532Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T04:57:57.629561Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T04:57:57.629564Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T04:57:57.629569Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-04T04:57:57.101Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "beb6602c-f3ee-43e3-b1d2-04b0cd862ed0" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.19:47192 - v1-model-routing [2026-11-04T04:57:57.613Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 16 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "eba35884-6b0c-4633-8ebf-c4d9c8b24fcd" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.35:443 10.132.0.19:47208 - v1-model-routing 2026-11-04T04:57:58.480432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:57:58.480469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:57:58.480482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:57:58.480487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T04:57:58.380Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 99 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "f9d8a30a-74bd-4a32-ae32-a3580b45b080" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:43234 10.132.0.35:443 10.132.0.19:47214 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T05:01:19.341690Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T05:01:19.341768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:01:19.341784Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:01:19.341831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:01:19.341838Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T05:01:19.648860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:01:19.648894Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:01:19.648906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:01:19.648911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T05:01:19.230Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 111 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "3b280c7c-2c01-432b-9c9d-2a4e8bf4321a" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:37520 10.132.0.35:443 10.132.0.19:43606 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T05:01:19.544Z] "DELETE /v1/api-keys/e3f3e42e-624d-4f65-b7e3-2f6dccb602ef HTTP/1.1" 200 - via_upstream - "-" 0 321 104 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8165a28a-9acf-44e5-8a1a-1f8dbb818531" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:37526 10.132.0.35:443 10.132.0.19:43608 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T05:01:42.111347Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:01:42.111384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:01:42.111396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T05:01:42.111401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T05:01:42.097Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 14 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "330d974e-a241-46f6-8fa5-609fe88b576c" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:37526 10.132.0.35:443 10.132.0.19:56466 - odh-ai-gateway-infra.maas-api-route.4 2026-11-04T05:03:16.981058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:03:16.981098Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:03:16.981114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T05:03:16.981120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T05:03:16.867Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 328 113 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "6a9601ce-9c71-4fa1-a8f1-454de95f557d" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:49056 10.132.0.35:443 10.132.0.19:56800 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T05:04:22.230204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:04:22.230240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:04:22.230252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T05:04:22.230256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T05:04:22.119Z] "DELETE /v1/api-keys/0bf6566b-4942-4b12-b679-84cdd7c6f4bd HTTP/1.1" 200 - via_upstream - "-" 0 370 110 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b05610da-1f8f-492c-8aa7-bf4f7c5db0bf" "maas.apps.e0daad7e8ccbbe5bacae.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.35:36146 10.132.0.35:443 10.132.0.19:53536 - odh-ai-gateway-infra.maas-api-route.3