2026-10-30T00:13:50.664611Z info FLAG: --concurrency="0" 2026-10-30T00:13:50.664630Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T00:13:50.664634Z info FLAG: --help="false" 2026-10-30T00:13:50.664636Z info FLAG: --log_as_json="false" 2026-10-30T00:13:50.664638Z info FLAG: --log_caller="" 2026-10-30T00:13:50.664640Z info FLAG: --log_output_level="default:info" 2026-10-30T00:13:50.664642Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T00:13:50.664647Z info FLAG: --log_target="[stdout]" 2026-10-30T00:13:50.664649Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T00:13:50.664651Z info FLAG: --outlierLogPath="" 2026-10-30T00:13:50.664653Z info FLAG: --profiling="true" 2026-10-30T00:13:50.664655Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T00:13:50.664657Z info FLAG: --proxyLogLevel="warning" 2026-10-30T00:13:50.664659Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T00:13:50.664661Z info FLAG: --stsPort="0" 2026-10-30T00:13:50.664663Z info FLAG: --templateFile="" 2026-10-30T00:13:50.664665Z info FLAG: --tokenManagerPlugin="" 2026-10-30T00:13:50.664667Z info FLAG: --vklog="0" 2026-10-30T00:13:50.664670Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T00:13:50.664801Z info Proxy role ips=[10.132.0.55] type=router id=maas-default-gateway-openshift-default-77bfb58f8c-ff75p.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T00:13:50.664838Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T00:13:50.666295Z info cpu limit detected as 2, setting concurrency 2026-10-30T00:13:50.666516Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T00:13:50.666527Z info JWT policy is third-party-jwt 2026-10-30T00:13:50.666530Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T00:13:50.667934Z info Starting default Istio SDS Server 2026-10-30T00:13:50.667960Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T00:13:50.667982Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T00:13:50.668405Z info Opening status port 15020 2026-10-30T00:13:50.669137Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T00:13:50.669603Z info sds Starting SDS grpc server 2026-10-30T00:13:50.669617Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T00:13:50.670319Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T00:13:50.671318Z info Starting proxy agent 2026-10-30T00:13:50.671357Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T00:13:50.737053Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T00:13:50.852856Z info ads ADS: new connection for node:1 2026-10-30T00:13:50.853198Z info ads ADS: new connection for node:2 2026-10-30T00:13:50.868228Z info cache generated new workload certificate resourceName=default latency=198.535219ms ttl=23h59m59.131775187s 2026-10-30T00:13:50.868261Z info cache Root cert has changed, start rotating root cert 2026-10-30T00:13:50.868302Z info cache returned workload trust anchor from cache ttl=23h59m59.131699338s 2026-10-30T00:13:50.868316Z info cache returned workload certificate from cache ttl=23h59m59.13168495s 2026-10-30T00:13:50.868602Z info cache returned workload trust anchor from cache ttl=23h59m59.131401068s 2026-10-30T00:13:50.870001Z info cache returned workload trust anchor from cache ttl=23h59m59.130000984s 2026-10-30T00:13:50.955498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:13:59.050288Z info Readiness succeeded in 8.388267319s 2026-10-30T00:13:59.050656Z info Envoy proxy is ready [2026-10-30T00:14:01.042Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 62 - "34.228.250.194,10.132.0.21" "curl/7.76.1" "73c598e7-05d2-4196-8c13-30025d0eb492" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.55:443 10.132.0.21:34812 - v1-model-routing 2026-10-30T00:19:48.184848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:21:12.988674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:12.988830Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:12.988885Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T00:21:12.988940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T00:21:11.419Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 1569 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "932e0afb-5f4a-4dc5-a10f-ca51469a0c70" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:49540 10.132.0.55:443 10.132.0.21:57850 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:21:17.424178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:17.424308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:17.424359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T00:21:17.424389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T00:21:17.263Z] "DELETE /v1/api-keys/0f60a506-ef52-43fb-a300-2f08e6f45773 HTTP/1.1" 200 - via_upstream - "-" 0 321 161 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "04e3d387-bb6b-464a-88c8-f6d2bc1ecbb2" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:49540 10.132.0.55:443 10.132.0.21:33464 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:21:18.544036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:18.544077Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:18.544096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:18.544102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T00:21:18.422Z] "DELETE /v1/api-keys/b1c0b6c4-d028-4cf1-acc6-3a87623b1d31 HTTP/1.1" 200 - via_upstream - "-" 0 321 121 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "e2e3ec3b-129f-4830-8222-22276949cca4" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:49540 10.132.0.55:443 10.132.0.21:33476 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:21:28.251203Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:28.251340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:28.251392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:21:28.251423Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T00:21:28.056Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 195 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "255ebf55-57e8-49a4-8b20-86b39a002350" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:49540 10.132.0.55:443 10.132.0.21:60674 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:21:33.906132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:21:33.906270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:21:33.906333Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:21:33.906364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:21:33.661Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 244 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "bc1fc2c7-5f72-41b3-ad69-ee44c7ff8f27" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:39182 10.132.0.55:443 10.132.0.21:51912 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:22:00.282558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:22:40.320280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T00:28:15.756015Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:28:15.756059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:28:15.756081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:28:15.756087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:28:15.642Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 113 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "8ebd47ef-d0b5-48c3-83ea-9cd1927d52b1" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:47100 10.132.0.55:443 10.132.0.21:39052 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:31:42.759296Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:31:42.759331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:31:42.759343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T00:31:42.759348Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T00:31:42.759535Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T00:31:42.759589Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T00:31:42.759598Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T00:31:42.759600Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T00:31:42.759604Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T00:31:42.622Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 126 129 137 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "061cd9cb-68d5-41be-b349-be3e3127662f" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.55:59258 10.132.0.55:443 10.132.0.21:33750 - v1-chat-completions-path 2026-10-30T00:32:24.826227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:32:24.826350Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T00:32:24.826417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T00:32:24.826449Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T00:32:24.423Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 402 - "34.228.250.194,10.132.0.21" "python-requests/2.34.2" "a826116b-bf31-45fe-a416-6510aaa13a70" "maas.apps.9fa7ee5ef5201ea211f0.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.55:51762 10.132.0.55:443 10.132.0.21:53804 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T00:37:49.473299Z warn xdsproxy upstream terminated with unexpected error rpc error: code = Unavailable desc = error reading from server: read tcp 10.132.0.55:38196->172.31.99.202:15012: read: connection reset by peer id=1 2026-10-30T00:37:49.568168Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2