2026-10-29T22:49:41.646171Z info FLAG: --concurrency="0" 2026-10-29T22:49:41.646196Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-29T22:49:41.646200Z info FLAG: --help="false" 2026-10-29T22:49:41.646202Z info FLAG: --log_as_json="false" 2026-10-29T22:49:41.646204Z info FLAG: --log_caller="" 2026-10-29T22:49:41.646206Z info FLAG: --log_output_level="default:info" 2026-10-29T22:49:41.646208Z info FLAG: --log_stacktrace_level="default:none" 2026-10-29T22:49:41.646216Z info FLAG: --log_target="[stdout]" 2026-10-29T22:49:41.646219Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-29T22:49:41.646220Z info FLAG: --outlierLogPath="" 2026-10-29T22:49:41.646223Z info FLAG: --profiling="true" 2026-10-29T22:49:41.646224Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-29T22:49:41.646226Z info FLAG: --proxyLogLevel="warning" 2026-10-29T22:49:41.646228Z info FLAG: --serviceCluster="istio-proxy" 2026-10-29T22:49:41.646230Z info FLAG: --stsPort="0" 2026-10-29T22:49:41.646232Z info FLAG: --templateFile="" 2026-10-29T22:49:41.646235Z info FLAG: --tokenManagerPlugin="" 2026-10-29T22:49:41.646237Z info FLAG: --vklog="0" 2026-10-29T22:49:41.646240Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-29T22:49:41.646376Z info Proxy role ips=[10.134.0.29] type=router id=maas-default-gateway-openshift-default-6db586dd6c-x7gtt.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-29T22:49:41.646424Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-29T22:49:41.647435Z info cpu limit detected as 2, setting concurrency 2026-10-29T22:49:41.647643Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-29T22:49:41.647655Z info JWT policy is third-party-jwt 2026-10-29T22:49:41.647657Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-29T22:49:41.649199Z info Starting default Istio SDS Server 2026-10-29T22:49:41.649224Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-29T22:49:41.649248Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-29T22:49:41.649444Z info Opening status port 15020 2026-10-29T22:49:41.650248Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-29T22:49:41.651568Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-29T22:49:41.652480Z info Starting proxy agent 2026-10-29T22:49:41.652552Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-29T22:49:41.661349Z info sds Starting SDS grpc server 2026-10-29T22:49:41.662830Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-29T22:49:41.707232Z info cache generated new workload certificate resourceName=default latency=55.602472ms ttl=23h59m59.292771944s 2026-10-29T22:49:41.707272Z info cache Root cert has changed, start rotating root cert 2026-10-29T22:49:41.707314Z info cache returned workload trust anchor from cache ttl=23h59m59.292687722s 2026-10-29T22:49:41.716738Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-29T22:49:41.839309Z info ads ADS: new connection for node:1 2026-10-29T22:49:41.839385Z info cache returned workload certificate from cache ttl=23h59m59.160618343s 2026-10-29T22:49:41.840476Z info ads ADS: new connection for node:2 2026-10-29T22:49:41.840552Z info cache returned workload trust anchor from cache ttl=23h59m59.159449661s 2026-10-29T22:49:41.924801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:49:50.245819Z info Readiness succeeded in 8.602082931s 2026-10-29T22:49:50.246128Z info Envoy proxy is ready [2026-10-29T22:50:00.627Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 370 187 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "a7ac925b-92b7-4df2-b2ea-3690691a79e9" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:48162 10.134.0.29:443 10.132.0.9:35212 - v1-model-routing [2026-10-29T22:50:01.524Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 92 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "9e200d0c-62c5-4ca3-bfa2-95548fd0059e" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.29:443 10.132.0.9:35224 - v1-model-routing [2026-10-29T22:50:02.026Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 87 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "65819147-bc41-4c91-b319-8efec48c4164" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.29:443 10.132.0.9:35240 - v1-model-routing 2026-10-29T22:50:02.904152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:50:02.904202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:50:02.904226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:50:02.904232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T22:50:02.815Z] "DELETE /v1/api-keys/9d80d1c2-a3f3-497e-9e2c-27e85836f1ce HTTP/1.1" 200 - via_upstream - "-" 0 365 88 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "c4b2f343-0eba-432f-926c-f011b58720d7" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.29:45684 10.134.0.29:443 10.132.0.9:35244 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:50:03.288607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:50:03.288651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:50:03.288667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:50:03.288674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T22:50:03.275Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 13 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "9c4d6268-5188-4a17-ab6f-0927380a7687" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.29:45684 10.134.0.29:443 10.132.0.9:35256 - odh-ai-gateway-infra.maas-api-route.4 2026-10-29T22:56:00.815616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:56:35.800396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:56:48.211015Z warn xdsproxy sendDownstreamDelta took 12.268271884s [2026-10-29T22:57:15.382Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 90 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "5757e467-2157-42c1-a0be-fca01613577f" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.29:443 10.132.0.9:40220 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T22:57:17.566460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:57:17.566576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T22:57:17.566606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T22:57:17.566614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T22:57:17.143Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 423 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "aa405e4e-cf14-4632-a241-0e8bdaddcdcf" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.29:41070 10.134.0.29:443 10.132.0.9:40224 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T22:57:35.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 96 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "1829e7a4-8c78-4500-9d1f-c28ae3cae1b5" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:48162 10.134.0.29:443 10.132.0.9:44566 - v1-completions-path [2026-10-29T22:57:41.470Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 85 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "6ecc2e8f-12d8-48e3-bc4b-89a7afa14dac" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:60050 10.134.0.29:443 10.132.0.9:33446 - v1-completions-path 2026-10-29T22:57:57.189467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T22:58:07.574897Z warn xdsproxy sendDownstreamDelta took 10.066434158s 2026-10-29T23:04:53.121409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:04:53.121454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:04:53.121474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:04:53.121481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:04:53.508839Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:04:53.509148Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-29T23:04:52.838Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 283 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "2f241b4f-6739-4988-83b2-31ff68f21eef" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.29:33766 10.134.0.29:443 10.132.0.9:43296 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:04:53.144Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 1808 364 - "44.212.242.249,10.132.0.9" "python-requests/2.34.2" "742af603-6d86-457f-b8ba-2f5ca7d99fe2" "maas.apps.0166774a2fae7fe1abe7.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.29:48162 10.134.0.29:443 10.132.0.9:43304 - v1-chat-completions-path 2026-10-29T23:20:29.519978Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-29T23:21:53.628492Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:22:59.296277Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:25:27.198870Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-29T23:26:14.151821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:27:04.697374Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:28:34.391536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8