2026-11-04T03:57:27.725991Z info FLAG: --concurrency="0" 2026-11-04T03:57:27.726009Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-04T03:57:27.726013Z info FLAG: --help="false" 2026-11-04T03:57:27.726015Z info FLAG: --log_as_json="false" 2026-11-04T03:57:27.726017Z info FLAG: --log_caller="" 2026-11-04T03:57:27.726019Z info FLAG: --log_output_level="default:info" 2026-11-04T03:57:27.726022Z info FLAG: --log_stacktrace_level="default:none" 2026-11-04T03:57:27.726031Z info FLAG: --log_target="[stdout]" 2026-11-04T03:57:27.726033Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-04T03:57:27.726035Z info FLAG: --outlierLogPath="" 2026-11-04T03:57:27.726037Z info FLAG: --profiling="true" 2026-11-04T03:57:27.726039Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-04T03:57:27.726041Z info FLAG: --proxyLogLevel="warning" 2026-11-04T03:57:27.726043Z info FLAG: --serviceCluster="istio-proxy" 2026-11-04T03:57:27.726045Z info FLAG: --stsPort="0" 2026-11-04T03:57:27.726047Z info FLAG: --templateFile="" 2026-11-04T03:57:27.726048Z info FLAG: --tokenManagerPlugin="" 2026-11-04T03:57:27.726051Z info FLAG: --vklog="0" 2026-11-04T03:57:27.726053Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-04T03:57:27.726198Z info Proxy role ips=[10.132.0.55] type=router id=maas-default-gateway-openshift-default-7d64fcddb7-4tpt8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-04T03:57:27.726246Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-04T03:57:27.727677Z info cpu limit detected as 2, setting concurrency 2026-11-04T03:57:27.727910Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-04T03:57:27.727936Z info JWT policy is third-party-jwt 2026-11-04T03:57:27.727939Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-04T03:57:27.729409Z info Starting default Istio SDS Server 2026-11-04T03:57:27.729479Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-04T03:57:27.729508Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-04T03:57:27.730013Z info Opening status port 15020 2026-11-04T03:57:27.730719Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-04T03:57:27.731467Z info sds Starting SDS grpc server 2026-11-04T03:57:27.731484Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-04T03:57:27.732172Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-04T03:57:27.732982Z info Starting proxy agent 2026-11-04T03:57:27.733011Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-04T03:57:27.797799Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-04T03:57:27.897308Z info ads ADS: new connection for node:1 2026-11-04T03:57:27.897948Z info ads ADS: new connection for node:2 2026-11-04T03:57:27.915800Z info cache generated new workload certificate resourceName=default latency=184.187221ms ttl=23h59m59.084202883s 2026-11-04T03:57:27.915828Z info cache Root cert has changed, start rotating root cert 2026-11-04T03:57:27.915862Z info cache returned workload trust anchor from cache ttl=23h59m59.084138133s 2026-11-04T03:57:27.915875Z info cache returned workload certificate from cache ttl=23h59m59.084125703s 2026-11-04T03:57:27.916302Z info cache returned workload trust anchor from cache ttl=23h59m59.083703095s 2026-11-04T03:57:27.916837Z info cache returned workload trust anchor from cache ttl=23h59m59.08316451s 2026-11-04T03:57:27.996272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:57:36.413672Z info Readiness succeeded in 8.69030901s 2026-11-04T03:57:36.418028Z info Envoy proxy is ready 2026-11-04T03:57:43.151218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-04T03:57:46.165083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-04T03:58:17.982Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 458 82 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "cd13d0c8-d74f-4548-826c-9d8b03fc8013" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.55:59722 10.132.0.55:443 10.132.0.9:60316 - v1-model-routing [2026-11-04T03:58:18.285Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 55 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "6db2985e-c261-4666-a55b-19e6ff4623c6" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.55:443 10.132.0.9:60330 - v1-model-routing [2026-11-04T03:58:18.732Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "e317af66-3dc3-4ece-b657-258aa0f40948" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.55:443 10.132.0.9:60332 - v1-model-routing 2026-11-04T04:00:10.732517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:10.732557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:10.732574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:10.732580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T04:00:10.088Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 37 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "52b45461-97f9-4fea-b335-c49733dbebdb" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.55:443 10.132.0.9:38330 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T04:00:10.666Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 65 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "881d2b0f-c48d-4503-846d-65284b5b7820" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:51134 10.132.0.55:443 10.132.0.9:38344 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T04:00:11.591313Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:00:11.591340Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:00:11.591343Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-04T04:00:11.591347Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-04T04:00:11.544Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 46 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "a89b55be-ffa9-4378-873b-969ed05f67db" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.55:443 10.132.0.9:38352 - v1-completions-path 2026-11-04T04:00:20.297273Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:20.297306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:20.297319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-04T04:00:20.297324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-04T04:00:20.233Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 63 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "b71a6827-cdcc-4984-a5bc-a86b89b109c7" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:51134 10.132.0.55:443 10.132.0.9:43410 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T04:00:26.470Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 88 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "aa644f2a-aee9-4524-a48d-99a2d873e96c" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.54:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.55:51652 10.132.0.55:443 10.132.0.9:54290 - v1-completions-path [2026-11-04T04:00:26.964Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 11 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "9e76e06f-29cc-4b57-ab1e-5d67c5692c7d" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.55:443 10.132.0.9:54302 - - 2026-11-04T04:00:40.451208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:00:40.451240Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:00:40.451253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:00:40.451258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T04:00:40.224Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 68 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "4fc8718f-33ac-4894-8ba9-45541fd80ce6" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.55:443 10.132.0.9:46366 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-04T04:00:40.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 100 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "70d82822-0bc5-420a-9f60-455f8eebe7b6" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:39588 10.132.0.55:443 10.132.0.9:46380 - odh-ai-gateway-infra.maas-api-route.3 2026-11-04T04:01:23.888354Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:01:23.888386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:01:23.888397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-04T04:01:23.888402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-04T04:01:23.799Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 86 328 89 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "c46c9f3f-30ce-47e6-bf71-565a28e5db0f" "maas.apps.9a8581fc44250847a02c.prod.konflux-ocp-ci.dev" "10.132.0.50:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:39588 10.132.0.55:443 10.132.0.9:52762 - odh-ai-gateway-infra.maas-api-route.3