2026-10-31T00:00:40.820386Z info FLAG: --concurrency="0" 2026-10-31T00:00:40.820408Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-31T00:00:40.820414Z info FLAG: --help="false" 2026-10-31T00:00:40.820417Z info FLAG: --log_as_json="false" 2026-10-31T00:00:40.820421Z info FLAG: --log_caller="" 2026-10-31T00:00:40.820424Z info FLAG: --log_output_level="default:info" 2026-10-31T00:00:40.820426Z info FLAG: --log_stacktrace_level="default:none" 2026-10-31T00:00:40.820433Z info FLAG: --log_target="[stdout]" 2026-10-31T00:00:40.820435Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-31T00:00:40.820437Z info FLAG: --outlierLogPath="" 2026-10-31T00:00:40.820439Z info FLAG: --profiling="true" 2026-10-31T00:00:40.820443Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-31T00:00:40.820446Z info FLAG: --proxyLogLevel="warning" 2026-10-31T00:00:40.820449Z info FLAG: --serviceCluster="istio-proxy" 2026-10-31T00:00:40.820452Z info FLAG: --stsPort="0" 2026-10-31T00:00:40.820455Z info FLAG: --templateFile="" 2026-10-31T00:00:40.820457Z info FLAG: --tokenManagerPlugin="" 2026-10-31T00:00:40.820462Z info FLAG: --vklog="0" 2026-10-31T00:00:40.820464Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-31T00:00:40.820668Z info Proxy role ips=[10.133.1.8] type=router id=maas-default-gateway-openshift-default-5df48fcc99-659rv.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-31T00:00:40.820721Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-31T00:00:40.821963Z info cpu limit detected as 2, setting concurrency 2026-10-31T00:00:40.822176Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-31T00:00:40.822189Z info JWT policy is third-party-jwt 2026-10-31T00:00:40.822191Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-31T00:00:40.824101Z info Starting default Istio SDS Server 2026-10-31T00:00:40.824128Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-31T00:00:40.824154Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-31T00:00:40.824706Z info Opening status port 15020 2026-10-31T00:00:40.826366Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-31T00:00:40.827102Z info sds Starting SDS grpc server 2026-10-31T00:00:40.827182Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-31T00:00:40.828469Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-31T00:00:40.829677Z info Starting proxy agent 2026-10-31T00:00:40.829720Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-31T00:00:40.894431Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-31T00:00:40.968915Z info cache generated new workload certificate resourceName=default latency=141.586649ms ttl=23h59m59.031107245s 2026-10-31T00:00:40.968954Z info cache Root cert has changed, start rotating root cert 2026-10-31T00:00:40.968986Z info cache returned workload trust anchor from cache ttl=23h59m59.031014472s 2026-10-31T00:00:41.065662Z info ads ADS: new connection for node:1 2026-10-31T00:00:41.065747Z info cache returned workload certificate from cache ttl=23h59m58.934255016s 2026-10-31T00:00:41.067467Z info ads ADS: new connection for node:2 2026-10-31T00:00:41.067566Z info cache returned workload trust anchor from cache ttl=23h59m58.932437243s 2026-10-31T00:00:41.150339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:00:49.247443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:00:50.323823Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-31T00:00:51.660187Z info Readiness succeeded in 10.843064332s 2026-10-31T00:00:51.660696Z info Envoy proxy is ready 2026-10-31T00:01:04.479050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:01:15.273Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 86 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "f6002e8e-323d-4b01-8d9c-88530154501e" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.8:56086 10.133.1.8:443 10.132.0.12:47584 - v1-completions-path 2026-10-31T00:01:35.596713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:01:46.101072Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:01:52.554833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:02:07.151Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 71 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "3cea4d9b-1fa2-42dd-ba6d-03f0b24e7de8" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.40:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.8:46424 10.133.1.8:443 10.132.0.12:38486 - v1-completions-path 2026-10-31T00:02:23.999918Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:02:28.758642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:02:52.011636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-31T00:02:53.396Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 78 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "a61a6ad9-0d46-4564-b25c-7f0f394e9ef2" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.41:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.8:58286 10.133.1.8:443 10.132.0.12:40050 - v1-completions-path 2026-10-31T00:02:58.596878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:24.690757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:46.564537Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:03:59.862069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:24.157182Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:04:24.157227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:04:24.157250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:04:24.157255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:04:24.041Z] "DELETE /v1/api-keys/61efdef3-ec52-4821-a041-d01c0a661a3c HTTP/1.1" 200 - via_upstream - "-" 0 375 115 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "182e5331-74e0-4ba9-87ee-a7d68cbb4796" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.8:42834 10.133.1.8:443 10.132.0.12:45308 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:04:32.165848Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:04:53.747556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:05:04.363110Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:07:22.638362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:07:22.638398Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:07:22.638412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T00:07:22.638417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T00:07:22.519Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 118 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "20d0de21-90b5-4b21-be10-f3220ff83eaa" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.8:49586 10.133.1.8:443 10.132.0.12:33400 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:09:09.178268Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:09:26.253172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:09:30.852258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:09:41.656469Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:09:41.656501Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:09:41.656504Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-31T00:09:41.656508Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-31T00:09:41.621Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 123 35 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "513fc133-8f2e-4453-a53e-a6f475794a73" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.8:443 10.132.0.12:49836 - v1-completions-path 2026-10-31T00:09:55.215845Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:04.602045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:12:45.647323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:13.002304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:13.002344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:13.002362Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:13.002367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:13:12.934Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 628 67 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "adf8a9dd-1cdd-47f9-8f45-a7363230107c" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.8:51454 10.133.1.8:443 10.132.0.12:42166 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:13:15.319674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:30.497455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:36.802137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:36.802165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-31T00:13:36.802179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:13:36.802197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-31T00:13:36.802201Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-31T00:13:36.740Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 61 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "6d2ea64f-587d-42ea-9815-9c1875fb07d6" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.8:51454 10.133.1.8:443 10.132.0.12:51686 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:13:38.962450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:52.459129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:13:57.336700Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:14:04.813500Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:14:04.813549Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:14:04.813569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-31T00:14:04.813577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-31T00:14:04.687Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 126 - "34.228.250.194,10.132.0.12" "python-requests/2.34.2" "a30817db-808e-447b-975c-7e6fa5a3fb50" "maas.apps.0316192e457c1607fc98.prod.konflux-ocp-ci.dev" "10.134.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.8:51454 10.133.1.8:443 10.132.0.12:48728 - odh-ai-gateway-infra.maas-api-route.3 2026-10-31T00:14:19.989803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:17:45.084613Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:17:56.600394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:17.563796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:22.232588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:36.669711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-31T00:18:48.370174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8