2026-11-04T02:59:25.908900Z info FLAG: --concurrency="0" 2026-11-04T02:59:25.908917Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T02:59:25.908922Z info FLAG: --help="false" 2026-11-04T02:59:25.908924Z info FLAG: --log_as_json="false" 2026-11-04T02:59:25.908926Z info FLAG: --log_caller="" 2026-11-04T02:59:25.908928Z info FLAG: --log_output_level="default:info" 2026-11-04T02:59:25.908930Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T02:59:25.908943Z info FLAG: --log_target="[stdout]" 2026-11-04T02:59:25.908946Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T02:59:25.908948Z info FLAG: --outlierLogPath="" 2026-11-04T02:59:25.908950Z info FLAG: --profiling="true" 2026-11-04T02:59:25.908952Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T02:59:25.908954Z info FLAG: --proxyLogLevel="warning" 2026-11-04T02:59:25.908956Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T02:59:25.908958Z info FLAG: --stsPort="0" 2026-11-04T02:59:25.908960Z info FLAG: --templateFile="" 2026-11-04T02:59:25.908962Z info FLAG: --tokenManagerPlugin="" 2026-11-04T02:59:25.908965Z info FLAG: --vklog="0" 2026-11-04T02:59:25.908967Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T02:59:25.909107Z info Proxy role ips=[10.134.0.17] type=router id=maas-default-gateway-openshift-default-855f9574cf-p9gc5.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T02:59:25.909153Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T02:59:25.910286Z info cpu limit detected as 2, setting concurrency 2026-11-04T02:59:25.910490Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T02:59:25.910502Z info JWT policy is third-party-jwt 2026-11-04T02:59:25.910505Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T02:59:25.912061Z info Starting default Istio SDS Server 2026-11-04T02:59:25.912079Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T02:59:25.912096Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T02:59:25.912350Z info Opening status port 15020 2026-11-04T02:59:25.913102Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T02:59:25.913859Z info sds Starting SDS grpc server 2026-11-04T02:59:25.913874Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T02:59:25.914866Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T02:59:25.915874Z info Starting proxy agent 2026-11-04T02:59:25.915910Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T02:59:25.977605Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T02:59:25.989322Z info cache generated new workload certificate resourceName=default latency=75.317695ms ttl=23h59m59.010680878s 2026-11-04T02:59:25.989352Z info cache Root cert has changed, start rotating root cert 2026-11-04T02:59:25.989379Z info cache returned workload trust anchor from cache ttl=23h59m59.010621127s 2026-11-04T02:59:26.061456Z info ads ADS: new connection for node:1 2026-11-04T02:59:26.061517Z info cache returned workload certificate from cache ttl=23h59m58.938484697s 2026-11-04T02:59:26.061988Z info ads ADS: new connection for node:2 2026-11-04T02:59:26.062059Z info cache returned workload trust anchor from cache ttl=23h59m58.937941626s 2026-11-04T02:59:26.104041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T02:59:32.552778Z info Readiness succeeded in 6.646206397s 2026-11-04T02:59:32.553097Z info Envoy proxy is ready 2026-11-04T03:00:39.757796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:00:40.301883Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:19.725502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:21.751676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:24.905385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:26.026459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:27.565267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:29.569295Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:32.303525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:01:55.497237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.497271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.497283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.497288Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:01:55.409Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 87 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "c10006a5-c7ca-4c55-bee1-4572029f581b" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:58996 10.134.0.17:443 10.132.0.21:55212 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:01:55.686474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.686508Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.686522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:55.686527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:01:55.591Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 95 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "28736d0b-6a27-47f7-9409-8961e6a0fc04" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:58996 10.134.0.17:443 10.132.0.21:55228 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:01:55.784Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 328 112 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "daea6a21-3dda-4916-97ea-72621e56c354" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.17:50420 10.134.0.17:443 10.132.0.21:55230 - v1-model-routing [2026-11-04T03:01:55.983Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 341 65 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "3dd2fe4c-91fa-4dfb-bb0a-f12c53f79eef" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.17:50420 10.134.0.17:443 10.132.0.21:55234 - v1-model-routing [2026-11-04T03:01:56.108Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 509 78 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "f93c020d-a273-4e36-a876-e157445ef0dd" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.17:50422 10.134.0.17:443 10.132.0.21:55238 - v1-model-routing [2026-11-04T03:01:56.274Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 443 68 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "520a2c95-bfe9-4f18-aeb0-884b9a391b56" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.132.0.53:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.17:50420 10.134.0.17:443 10.132.0.21:55252 - v1-model-routing [2026-11-04T03:01:56.420Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 71 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "19862c41-7cac-4a22-975a-1e9ce7aeee7f" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55256 - v1-model-routing 2026-11-04T03:01:56.824057Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-04T03:01:56.560Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 85 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "93c8da13-1fd9-458a-983d-5e1c69ff6ae7" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55266 - v1-model-routing [2026-11-04T03:01:56.762Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "55b8e0f8-9948-41c8-bbe7-5b4e1062ded1" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55278 - v1-model-routing [2026-11-04T03:01:56.886Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 58 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "a3ba8ed3-a294-4494-9f01-954fc1e89d0e" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55294 - v1-model-routing [2026-11-04T03:01:57.027Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 65 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "2620cf6f-00b7-42c3-8699-dea91acb44f1" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55302 - v1-model-routing [2026-11-04T03:01:57.252Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 60 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "a38bdfdb-b669-48a4-a7c2-81a7c84899f3" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55310 - v1-model-routing [2026-11-04T03:01:57.381Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "0e4d9d75-4299-41c3-ad0c-73231bc8efb5" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55314 - v1-model-routing 2026-11-04T03:01:57.528751Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:01:57.528771Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:01:57.528774Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-04T03:01:57.528778Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 2026-11-04T03:01:57.607875Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-04T03:01:57.668012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:57.668052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:57.668070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:01:57.668076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.113420Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.113454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.113470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:01:58.113474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.242675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.242736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:01:58.242752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:01:58.242756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T03:01:57.507Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 21 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "71bbe376-5f03-4b22-be3c-b5e94c782ea2" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.17:443 10.132.0.21:55322 - v1-model-routing [2026-11-04T03:01:57.602Z] "DELETE /v1/api-keys/6dbc3fa8-0a3a-451a-903b-a9202f792b0e HTTP/1.1" 200 - via_upstream - "-" 0 365 66 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "8e08fb58-ad0d-483a-97e1-24d87645fb92" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:58996 10.134.0.17:443 10.132.0.21:55328 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:01:58.105Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 8 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "9a8bfc40-3a5b-4919-9c7e-88fe2bee5b7e" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:58996 10.134.0.17:443 10.132.0.21:55340 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-04T03:01:58.181Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 60 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "9c3cd0be-a128-4bbc-b922-d5d80b678fef" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:58996 10.134.0.17:443 10.132.0.21:55356 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:04:37.259139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:37.259179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:37.259199Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:37.259205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:04:37.161Z] "DELETE /v1/api-keys/d41859e1-6259-4dc3-92c4-0290f99fbf30 HTTP/1.1" 200 - via_upstream - "-" 0 321 97 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "476c8f9b-99d7-4287-9f34-5ed9cfdccc0d" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44050 10.134.0.17:443 10.132.0.21:59516 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:04:38.211164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:38.211282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:38.211334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:04:38.211363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-04T03:04:38.149Z] "DELETE /v1/api-keys/f08e298a-52a3-4c93-9825-0bcb02ea5ac0 HTTP/1.1" 200 - via_upstream - "-" 0 321 62 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "155168bd-9e97-4224-87f3-fb7f4ceb8992" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44050 10.134.0.17:443 10.132.0.21:59520 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:04:38.264Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 44 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "5e782bcd-9a1c-456f-b832-ada162c2551a" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.17:443 10.132.0.21:59528 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:04:38.741265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:38.741298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:38.741313Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-04T03:04:38.741317Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:39.034560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:04:39.034594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:04:39.034610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-04T03:04:39.034614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-04T03:04:38.683Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 57 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "e5b4a859-bac8-4c30-99d5-2e97585137e9" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44050 10.134.0.17:443 10.132.0.21:59544 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:04:38.972Z] "DELETE /v1/api-keys/20faf8e1-4f1d-4591-99d2-77daa18ed951 HTTP/1.1" 200 - via_upstream - "-" 0 321 61 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "4ca27e4a-2984-47c7-ad09-937dbd460766" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44062 10.134.0.17:443 10.132.0.21:59558 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:04:47.567560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:04:47.567594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:04:47.567608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T03:04:47.567613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T03:04:47.555Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 12 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "e479654f-0da9-4a60-8d49-008204739de4" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44062 10.134.0.17:443 10.132.0.21:47128 - odh-ai-gateway-infra.maas-api-route.4 2026-11-04T03:04:48.028527Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:48.028565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:48.028580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:04:48.028586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:04:47.970Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 57 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "b75cd2a1-80c8-4070-b5bd-1b7f2602ade0" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:44050 10.134.0.17:443 10.132.0.21:47132 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T03:05:49.178Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 10 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "3ec4f06b-a6b8-454f-b303-94e453601947" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.17:443 10.132.0.21:48032 - - 2026-11-04T03:05:54.980299Z info ads ADS: new connection for node:3 2026-11-04T03:05:54.986300Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-04T03:05:54.986355Z info cache read certificate from file resource=file-root:system 2026-11-04T03:05:55.614956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:06:05.868817Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:06:28.615664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:06:32.353442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:06:32.353480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:06:32.353498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T03:06:32.353504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T03:06:32.154Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 308 198 - "44.212.242.249,10.132.0.21" "python-requests/2.34.2" "4768973c-fdc8-40e1-bbeb-9e00d0fa0eea" "maas.apps.3a2c7e148c6d57bf3c2b.prod.konflux-ocp-ci.dev" "10.133.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.17:56220 10.134.0.17:443 10.132.0.21:38602 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T03:06:58.694191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:07:53.685236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:08:11.393616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:08:25.581248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:08:47.586553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:08:59.874622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:09:16.184576Z info ads ADS: "" 3 terminated with stream closed 2026-11-04T03:09:16.521403Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:09:26.822462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8